Nov 06 21:32:25 devstack cinder-volume[76005]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:32:25 devstack cinder-volume[76005]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:32:25 devstack cinder-volume[76005]: we strongly recommend against using it for new projects. Nov 06 21:32:25 devstack cinder-volume[76005]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:32:25 devstack cinder-volume[76005]: framework. For more detail see Nov 06 21:32:25 devstack cinder-volume[76005]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:32:25 devstack cinder-volume[76005]: import eventlet # noqa Nov 06 21:32:28 devstack cinder-volume[76005]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76005) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:32:28 devstack cinder-volume[76005]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76005) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:32:28 devstack cinder-volume[76005]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76005) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:32:29 devstack cinder-volume[76005]: INFO dbcounter [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Registered counter for database cinder Nov 06 21:32:29 devstack cinder-volume[76005]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:32:29 devstack cinder-volume[76005]: DEBUG dbcounter [-] [76005] Writer thread running {{(pid=76005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:32:29 devstack cinder-volume[76005]: INFO cinder.rpc [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:32:29 devstack cinder-volume[76005]: INFO cinder.rpc [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:32:29 devstack cinder-volume[76005]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:32:29 devstack cinder-volume[76005]: INFO cinder.volume.manager [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Determined volume DB was empty at startup. Nov 06 21:32:29 devstack cinder-volume[76005]: DEBUG cinder.volume.manager [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76005) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 21:32:29 devstack cinder-volume[76005]: INFO cinder.volume.manager [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 21:32:29 devstack cinder-volume[76005]: WARNING stevedore.named [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:32:29 devstack cinder-volume[76005]: WARNING castellan.key_manager [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:32:29 devstack cinder-volume[76005]: WARNING cinder.keymgr.conf_key_mgr [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:32:29 devstack cinder-volume[76005]: DEBUG cinder.volume.drivers.lvm [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76005) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 21:32:29 devstack cinder-volume[76005]: DEBUG oslo_concurrency.processutils [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_concurrency.processutils [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] CMD "cinder-rtstool verify" returned: 0 in 0.480s {{(pid=76005) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:32:30 devstack cinder-volume[76005]: INFO cinder.rpc [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 21:32:30 devstack cinder-volume[76005]: INFO cinder.rpc [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 21:32:30 devstack cinder-volume[76005]: WARNING stevedore.named [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:32:30 devstack cinder-volume[76005]: WARNING castellan.key_manager [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:32:30 devstack cinder-volume[76005]: INFO cinder.volume.manager [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_db.sqlalchemy.engines [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76005) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:32:30 devstack cinder-volume[76005]: INFO oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Starting 1 workers Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Started child 76164 {{(pid=76005) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Full set of CONF: {{(pid=76005) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] ******************************************************************************** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Configuration options gathered from: {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] ================================================================================ {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] allow_availability_zone_fallback = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] allow_compression_on_image_upload = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76164]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] allowed_direct_url_schemes = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] api_rate_limit = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] auth_strategy = keystone {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] az_cache_duration = 3600 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_availability_zone = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_host = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_stats_polling_interval = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backup_api_class = cinder.backup.api.API {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backup_name_template = backup-%s {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backup_use_same_host = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backup_use_temp_snapshot = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] chap_password = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] chap_username = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_internal_tenant_project_id = c612eef1f63041d49ebe535edccfaa2d {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_internal_tenant_user_id = 6736dc263b694097b8c399f33b96d838 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cloned_volume_same_az = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cluster = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] compression_format = gzip {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] compute_api_class = cinder.compute.nova.API {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] config_dir = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] config_source = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] control_exchange = openstack {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] debug = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] default_availability_zone = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] default_group_type = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] default_volume_type = lvmdriver-1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] disk_geometry = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] driver_client_cert = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] driver_client_cert_key = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] driver_data_namespace = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] driver_ssl_cert_path = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] driver_ssl_cert_verify = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] driver_use_ssl = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] enable_force_upload = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] enable_new_services = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] enable_unsupported_driver = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] enforce_multipath_for_image_xfer = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] filter_function = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_api_insecure = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_api_ssl_compression = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_ca_certificates_file = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_catalog_info = image:glance:publicURL {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_certfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_keyfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_num_retries = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance_request_timeout = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] goodness_function = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] graceful_shutdown_timeout = 5 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] group_api_class = cinder.group.api.API {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] host = devstack {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_compress_on_upload = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_conversion_address_space_limit = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_conversion_cpu_limit = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_conversion_disable = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_introspection_address_space_limit = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_introspection_cpu_limit = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_upload_use_cinder_backend = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_upload_use_internal_tenant = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_volume_cache_enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_volume_cache_max_count = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] image_volume_cache_max_size_gb = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] init_host_max_objects_retrieval = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] instance_format = [instance: %(uuid)s] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] iscsi_target_flags = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] iscsi_write_cache = on {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] iser_helper = tgtadm {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] iser_ip_address = 192.168.122.13 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] iser_port = 3260 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_color = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_config_append = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_dir = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_file = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_options = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_rotate_interval = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_rotate_interval_type = days {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] log_rotation_type = none {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] max_age = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] max_logfile_count = 30 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] max_logfile_size_mb = 200 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] max_over_subscription_ratio = 20.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] message_reap_interval = 86400 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] message_ttl = 2592000 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] migration_create_volume_timeout_secs = 300 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] monkey_patch = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] monkey_patch_modules = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] my_ip = 192.168.122.13 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] no_snapshot_gb_quota = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] num_iser_scan_tries = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] num_shell_tries = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] num_volume_device_scan_tries = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] nvmeof_conn_info_version = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] nvmet_ns_id = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] nvmet_port_id = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] osapi_max_limit = 1000 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] osapi_volume_ext_list = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] osapi_volume_listen_port = 8776 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] osapi_volume_use_ssl = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] osapi_volume_workers = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] per_volume_size_limit = -1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] periodic_fuzzy_delay = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] periodic_interval = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] public_endpoint = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] publish_errors = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] quota_backup_gigabytes = 1000 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] quota_backups = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] quota_gigabytes = 1000 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] quota_groups = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] quota_snapshots = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] quota_volumes = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] rate_limit_burst = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] rate_limit_except_level = CRITICAL {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] rate_limit_interval = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] reinit_driver_count = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] replication_device = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] report_discard_supported = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] report_interval = 120 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] reservation_clean_interval = 86400 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] reservation_expire = 86400 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] reserved_image_namespaces = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] reserved_percentage = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] rpc_response_timeout = 120 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] run_external_periodic_tasks = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] scst_target_driver = iscsi {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] scst_target_iqn_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_down_time = 720 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] shell_completion = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] snapshot_name_template = snapshot-%s {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] snapshot_same_host = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] split_loggers = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] state_path = /opt/stack/data/cinder {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] storage_availability_zone = nova {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] storage_protocol = iSCSI {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] syslog_log_facility = LOG_USER {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] target_helper = lioadm {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] target_ip_address = 192.168.122.13 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] target_port = 3260 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] target_protocol = iscsi {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] target_secondary_ip_addresses = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] trace_flags = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] transport_url = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] until_refresh = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] use_chap_auth = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] use_default_quota_class = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] use_journal = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] use_json = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] use_multipath_for_image_xfer = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] use_stderr = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] use_syslog = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] verify_glance_signatures = enabled {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_api_class = cinder.volume.api.API {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_backend_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_clear = zero {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_clear_ionice = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_clear_size = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_copy_bps_limit = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_dd_blocksize = 1M {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_name_template = volume-%s {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_service_inithost_offload = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volume_usage_audit_period = month {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] zoning_mode = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_concurrency.disable_process_locking = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.auth_section = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.auth_type = password {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.auth_version = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.cache = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.certfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.include_service_catalog = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.insecure = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.interface = public {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.keyfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_password = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcache_username = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.region_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.service_type = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.backend = dogpile.cache.null {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.backend_argument = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.backend_expiration_time = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.config_prefix = cache.oslo {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.debug_cache_backend = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.enable_retry_client = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.enable_socket_keepalive = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.expiration_time = 600 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.hashclient_retry_attempts = 2 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.memcache_dead_retry = 300 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.memcache_pool_maxsize = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.memcache_sasl_enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.password = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.proxies = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.redis_db = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.redis_server = localhost:6379 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.retry_attempts = 2 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.retry_delay = 0.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.socket_keepalive_count = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.socket_keepalive_idle = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.socket_keepalive_interval = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.socket_timeout = 1.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.tls_allowed_ciphers = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.tls_cafile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.tls_certfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.tls_enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.tls_keyfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cache.username = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] coordination.backend_url = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.asyncio_connection = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.asyncio_slave_connection = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.backend = sqlalchemy {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.connection = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.connection_debug = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.connection_parameters = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.connection_recycle_time = 3600 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack sudo[76225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.connection_trace = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.db_inc_retry_interval = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.db_max_retries = 20 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.db_max_retry_interval = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.db_retry_interval = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.max_overflow = 50 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.max_pool_size = 5 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack sudo[76225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.max_retries = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.mysql_wsrep_sync_wait = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.pool_timeout = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.retry_interval = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.slave_connection = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.sqlite_synchronous = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.synchronous_reader = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] database.use_db_reconnect = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_tracing.insecure = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.connection_string = messaging:// {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.es_doc_type = notification {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.es_scroll_size = 10000 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.es_scroll_time = 2m {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.filter_error_trace = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.hmac_keys = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.sentinel_service_name = mymaster {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.socket_timeout = 0.1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.trace_requests = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler.trace_sqlalchemy = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler_jaeger.process_tags = {} {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler_jaeger.service_name_prefix = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] profiler_otlp.service_name_prefix = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.enforce_new_defaults = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.policy_default_rule = default {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.policy_file = policy.yaml {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] privsep_osbrick.group = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] privsep_osbrick.helper_command = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] privsep_osbrick.user = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_sys_admin.group = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_sys_admin.helper_command = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] cinder_sys_admin.user = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.auth_section = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.auth_type = password {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.cafile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.certfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.collect_timing = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.insecure = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.keyfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.send_service_user_token = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.split_loggers = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.timeout = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.tls_ciphers = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] service_user.tls_min_version = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.auth_section = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.auth_type = password {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.certfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.collect_timing = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.insecure = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.keyfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.region_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.split_loggers = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.timeout = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.tls_ciphers = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] glance.tls_min_version = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.backend_availability_zone = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.chap_password = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.chap_username = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.disk_geometry = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.driver_client_cert = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.driver_client_cert_key = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.driver_data_namespace = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.driver_use_ssl = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.extra_capabilities = {} {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.filter_function = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.goodness_function = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.iscsi_target_flags = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.iscsi_write_cache = on {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.iser_helper = tgtadm {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.iser_port = 3260 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.lvm_share_target = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.lvm_type = auto {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.num_shell_tries = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.replication_device = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.report_discard_supported = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.reserved_percentage = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.target_helper = tgtadm {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.target_port = 3260 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.target_protocol = iscsi {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.trace_flags = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.unique_fqdn_network = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.use_chap_auth = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_backend_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_clear = zero {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_clear_ionice = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_clear_size = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_reports.file_event_handler = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_reports.log_dir = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.backend_host = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.chap_password = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.chap_username = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.disk_geometry = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.driver_client_cert = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.extra_capabilities = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.filter_function = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.goodness_function = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.iser_helper = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.iser_ip_address = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.iser_port = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.lvm_share_target = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.lvm_type = auto {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.num_shell_tries = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.replication_device = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.report_discard_supported = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.reserved_percentage = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.scst_target_driver = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.storage_protocol = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.target_helper = lioadm {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.target_ip_address = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.target_port = 3260 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.trace_flags = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.use_chap_auth = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_clear = zero {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_clear_size = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] lvmdriver-1.volumes_dir = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.ssl = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_notifications.driver = [] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_notifications.retry = -1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] key_manager.fixed_key = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.barbican_api_version = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.barbican_endpoint = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.barbican_endpoint_type = public {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.barbican_region_name = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.cafile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.certfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.collect_timing = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.insecure = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.keyfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.number_of_retries = 60 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.retry_delay = 1 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.send_service_user_token = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.split_loggers = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.timeout = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.tls_ciphers = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.tls_min_version = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.verify_ssl = True {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican.verify_ssl_path = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.auth_section = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.auth_type = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.cafile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.certfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.collect_timing = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.insecure = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.keyfile = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.split_loggers = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.timeout = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.tls_ciphers = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] barbican_service_user.tls_min_version = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.approle_role_id = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.approle_secret_id = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.auth_method = approle {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.auth_path = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.kv_mountpoint = secret {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.kv_path = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.kv_version = 2 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.namespace = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.root_token_id = **** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.ssl_ca_crt_file = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.timeout = 60.0 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.token_file = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.token_role = None {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.use_ssl = False {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:32:30 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] ******************************************************************************** {{(pid=76005) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:32:30 devstack sudo[76225]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:30 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:30 devstack sudo[76351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:30 devstack sudo[76351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:31 devstack sudo[76351]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:31 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.322s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:31 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:32:31 devstack cinder-volume[76164]: INFO cinder.brick.local_dev.lvm [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 21:32:31 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:31 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:31 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:31 devstack sudo[76446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:32:31 devstack sudo[76446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:31 devstack sudo[76446]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:31 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:31 devstack cinder-volume[76164]: DEBUG cinder.brick.local_dev.lvm [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76164) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 21:32:31 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:31 devstack sudo[76521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:31 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:32 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.554s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:32 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:32 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:32 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:32 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 21:32:32 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:32 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.272s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:32 devstack sudo[76836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:32:32 devstack sudo[76836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:32 devstack sudo[76836]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:32 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:32 devstack sudo[76866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:32:33 devstack sudo[76866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:33 devstack sudo[76866]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:33 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:33 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:33 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:32:33 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:33 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:33 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:33 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:33 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:33 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:33 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:33 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:33 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:33 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:33 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:33 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:33 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:34 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:34 devstack cinder-volume[76164]: INFO cinder.volume.drivers.lvm [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:34 devstack sudo[76973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:34 devstack sudo[76973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:34 devstack sudo[76973]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:34 devstack sudo[76982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:32:34 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:34 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:34 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:32:34 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:34 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:34 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:34 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:34 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:35 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:35 devstack sudo[76991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:32:35 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:35 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:35 devstack cinder-volume[76164]: INFO cinder.volume.driver [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG cinder.volume.driver [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76164) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG oslo_db.sqlalchemy.engines [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writer thread running {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG cinder.db.api [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Building query based on filter {{(pid=76164) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG cinder.image.image_utils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76164) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:32:35 devstack cinder-volume[76164]: INFO cinder.keymgr.migration [None req-2bef5cda-06f1-400f-9d10-b3eae22efc88 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:35 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:32:35 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:35 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:35 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:35 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:32:35 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:36 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:36 devstack sudo[77002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:36 devstack sudo[77002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:36 devstack sudo[77002]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.364s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:36 devstack sudo[77006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:32:36 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:36 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:32:36 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Driver initialization completed successfully. Nov 06 21:32:36 devstack cinder-volume[76164]: INFO cinder.manager [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Initiating service 2 cleanup Nov 06 21:32:36 devstack cinder-volume[76164]: INFO cinder.manager [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Service 2 cleanup completed. Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG cinder.service [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Creating RPC server for service cinder-volume {{(pid=76164) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG cinder.service [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76164) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:32:36 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:32:36 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:36 devstack sudo[77009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:32:36 devstack sudo[77009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:37 devstack sudo[77009]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:37 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:37 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:37 devstack sudo[77017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:32:37 devstack sudo[77017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:37 devstack sudo[77017]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:37 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:37 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:37 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:32:37 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:37 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:37 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:37 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:32:37 devstack sudo[77023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:32:37 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:32:37 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root Nov 06 21:32:37 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:32:37 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-46f4e015-a278-4621-bf68-2b9fd57551ea None None] Driver post RPC initialization completed successfully. Nov 06 21:32:40 devstack cinder-volume[76005]: DEBUG dbcounter [-] [76005] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76005) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:47 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=4 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:32:48 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:38 devstack sudo[78964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:33:38 devstack sudo[78964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:38 devstack sudo[78964]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:38 devstack sudo[78967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:33:38 devstack sudo[78967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:38 devstack sudo[78967]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:38 devstack sudo[78981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:33:38 devstack sudo[78981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:38 devstack sudo[78981]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:33:38 devstack sudo[78991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:33:38 devstack sudo[78991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:33:39 devstack sudo[78991]: pam_unix(sudo:session): session closed for user root Nov 06 21:33:39 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:33:39 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:33:39 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running periodic task VolumeManager._thread_info {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:33:39 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] thread count: 6 {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:33:39 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] thread info: [<_MainThread(MainThread, started 139728365179008)>, , , , , ] {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:38 devstack sudo[82343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:34:38 devstack sudo[82343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:38 devstack sudo[82343]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:38 devstack sudo[82347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:34:38 devstack sudo[82347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:38 devstack sudo[82347]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:38 devstack sudo[82350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:34:38 devstack sudo[82350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:38 devstack sudo[82350]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:34:38 devstack sudo[82360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:34:38 devstack sudo[82360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:34:39 devstack sudo[82360]: pam_unix(sudo:session): session closed for user root Nov 06 21:34:39 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:34:39 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:34:39 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running periodic task VolumeManager._thread_info {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:34:39 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] thread count: 6 {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:34:39 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] thread info: [<_MainThread(MainThread, started 139728365179008)>, , , , , ] {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:34:48 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[84480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:35:38 devstack sudo[84480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack sudo[84480]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[84483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:35:38 devstack sudo[84483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack sudo[84483]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[84499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:35:38 devstack sudo[84499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:38 devstack sudo[84499]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:35:38 devstack sudo[84502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:35:38 devstack sudo[84502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:35:39 devstack sudo[84502]: pam_unix(sudo:session): session closed for user root Nov 06 21:35:39 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:35:39 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Updating volume stats {{(pid=76164) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[85763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 21:36:38 devstack sudo[85763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:38 devstack sudo[85763]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:36:38 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:38 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 21:36:38 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:38 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:38 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:36:38 devstack sudo[85773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 21:36:38 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:36:39 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root Nov 06 21:36:39 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:36:39 devstack cinder-volume[76164]: DEBUG cinder.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Notifying Schedulers of capabilities ... {{(pid=76164) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:36:39 devstack cinder-volume[76164]: DEBUG oslo_service.periodic_task [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] Running periodic task VolumeManager._thread_info {{(pid=76164) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:36:39 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] thread count: 6 {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:36:39 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-64145419-f1ca-4d4a-a140-2bd6681188d2 None None] thread info: [<_MainThread(MainThread, started 139728365179008)>, , , , , ] {{(pid=76164) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:36:48 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:36:48 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:UPDATE=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:36:54 devstack cinder-volume[76005]: INFO oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Caught SIGTERM, stopping children Nov 06 21:36:54 devstack cinder-volume[76005]: DEBUG oslo_concurrency.lockutils [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Acquiring lock "singleton_lock" {{(pid=76005) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:36:54 devstack cinder-volume[76005]: DEBUG oslo_concurrency.lockutils [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Acquired lock "singleton_lock" {{(pid=76005) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:36:54 devstack cinder-volume[76005]: DEBUG oslo_concurrency.lockutils [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Releasing lock "singleton_lock" {{(pid=76005) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:36:54 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Stop services. {{(pid=76005) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 21:36:54 devstack cinder-volume[76005]: DEBUG oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Killing children. {{(pid=76005) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 21:36:54 devstack cinder-volume[76005]: INFO oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Waiting on 1 children to exit Nov 06 21:36:56 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Acquiring lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:36:56 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Acquired lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:36:56 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Releasing lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:36:56 devstack cinder-volume[76164]: WARNING amqp [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:36:56 devstack cinder-volume[76164]: WARNING amqp [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:36:56 devstack cinder-volume[76005]: INFO oslo_service.backend._eventlet.service [None req-7dc07464-921b-472a-81f4-5a1a580ca540 None None] Child 76164 exited with status 0 Nov 06 21:36:57 devstack cinder-volume[86223]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:36:57 devstack cinder-volume[86223]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:36:57 devstack cinder-volume[86223]: we strongly recommend against using it for new projects. Nov 06 21:36:57 devstack cinder-volume[86223]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:36:57 devstack cinder-volume[86223]: framework. For more detail see Nov 06 21:36:57 devstack cinder-volume[86223]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:36:57 devstack cinder-volume[86223]: import eventlet # noqa Nov 06 21:36:59 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:36:59 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:36:59 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:37:00 devstack cinder-volume[86223]: INFO dbcounter [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Registered counter for database cinder Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG dbcounter [-] [86223] Writer thread running {{(pid=86223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:37:00 devstack cinder-volume[86223]: INFO cinder.rpc [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:37:00 devstack cinder-volume[86223]: INFO cinder.rpc [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:37:00 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Determined volume DB was empty at startup. Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG cinder.volume.manager [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86223) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 21:37:00 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 21:37:00 devstack cinder-volume[86223]: WARNING stevedore.named [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:37:00 devstack cinder-volume[86223]: WARNING castellan.key_manager [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:37:00 devstack cinder-volume[86223]: WARNING cinder.keymgr.conf_key_mgr [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:37:00 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:37:00 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Starting 1 workers Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Started child 86441 {{(pid=86223) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Full set of CONF: {{(pid=86223) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Configuration options gathered from: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] ================================================================================ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] allow_availability_zone_fallback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] allow_compression_on_image_upload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] allowed_direct_url_schemes = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] api_rate_limit = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] auth_strategy = keystone {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_stats_polling_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backup_api_class = cinder.backup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backup_name_template = backup-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backup_use_same_host = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86441]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_internal_tenant_project_id = c612eef1f63041d49ebe535edccfaa2d {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_internal_tenant_user_id = 6736dc263b694097b8c399f33b96d838 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cluster = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] compression_format = gzip {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] compute_api_class = cinder.compute.nova.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] config_dir = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] config_source = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] control_exchange = openstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] debug = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] default_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] default_group_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] default_volume_type = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] enable_new_services = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] enabled_backends = ['QuobyteHD'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_api_insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_api_ssl_compression = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_ca_certificates_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_catalog_info = image:glance:publicURL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_num_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance_request_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] graceful_shutdown_timeout = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] group_api_class = cinder.group.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] host = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_compress_on_upload = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_conversion_address_space_limit = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_conversion_cpu_limit = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_conversion_disable = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_introspection_address_space_limit = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_introspection_cpu_limit = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] init_host_max_objects_retrieval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] instance_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] iser_ip_address = 192.168.122.13 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_color = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_config_append = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_options = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_rotate_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_rotate_interval_type = days {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] log_rotation_type = none {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] max_age = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] max_logfile_count = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] max_logfile_size_mb = 200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] message_reap_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] message_ttl = 2592000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] migration_create_volume_timeout_secs = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] monkey_patch = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] monkey_patch_modules = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] my_ip = 192.168.122.13 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] no_snapshot_gb_quota = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] osapi_max_limit = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] osapi_volume_ext_list = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] osapi_volume_listen_port = 8776 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] osapi_volume_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] osapi_volume_workers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] per_volume_size_limit = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] periodic_fuzzy_delay = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] periodic_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] public_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] publish_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] quota_backup_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] quota_backups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] quota_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] quota_groups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] quota_snapshots = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] quota_volumes = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] rate_limit_burst = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] rate_limit_except_level = CRITICAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] rate_limit_interval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] reinit_driver_count = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] report_interval = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] reservation_clean_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] reservation_expire = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] reserved_image_namespaces = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] rpc_response_timeout = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] run_external_periodic_tasks = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 21:37:00 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.remotefs [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86441) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_down_time = 720 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] shell_completion = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] snapshot_name_template = snapshot-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] state_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] storage_availability_zone = nova {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] syslog_log_facility = LOG_USER {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] target_helper = lioadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] target_ip_address = 192.168.122.13 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] until_refresh = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] use_default_quota_class = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] use_journal = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] use_json = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] use_stderr = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] use_syslog = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] verify_glance_signatures = enabled {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_api_class = cinder.volume.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_name_template = volume-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_service_inithost_offload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volume_usage_audit_period = month {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] zoning_mode = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_concurrency.disable_process_locking = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.auth_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.include_service_catalog = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.interface = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcache_username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.service_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.backend = dogpile.cache.null {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.backend_argument = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.backend_expiration_time = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.config_prefix = cache.oslo {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.debug_cache_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.enable_retry_client = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.enable_socket_keepalive = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.expiration_time = 600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.hashclient_retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.memcache_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.proxies = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.redis_db = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.redis_server = localhost:6379 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.retry_delay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.socket_keepalive_count = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.socket_keepalive_idle = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.socket_keepalive_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.socket_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cache.username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] coordination.backend_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.asyncio_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.asyncio_slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.backend = sqlalchemy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.connection_debug = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.connection_parameters = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.connection_recycle_time = 3600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.connection_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.db_inc_retry_interval = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.db_max_retries = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.db_max_retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.db_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.max_overflow = 50 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.max_pool_size = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.max_retries = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.mysql_wsrep_sync_wait = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.pool_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.sqlite_synchronous = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.synchronous_reader = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] database.use_db_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_tracing.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.connection_string = messaging:// {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.es_doc_type = notification {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.es_scroll_size = 10000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.es_scroll_time = 2m {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.filter_error_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.hmac_keys = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.socket_timeout = 0.1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.trace_requests = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler.trace_sqlalchemy = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler_jaeger.process_tags = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler_jaeger.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] profiler_otlp.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.enforce_new_defaults = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.policy_default_rule = default {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.policy_file = policy.yaml {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] privsep_osbrick.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] privsep_osbrick.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] privsep_osbrick.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_sys_admin.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_sys_admin.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] cinder_sys_admin.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.send_service_user_token = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] service_user.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] glance.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.extra_capabilities = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_host = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_login = admin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86441) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_private_key = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_share_path = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86441]: WARNING cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86441]: WARNING cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Running cmd (subprocess): mount.quobyte {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.quobyte_volume_url = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.target_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.unique_fqdn_network = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_reports.file_event_handler = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_reports.log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.chap_username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.chiscsi_conf = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.driver_use_ssl = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.extra_capabilities = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:00 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.iser_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.iser_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.iser_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.iser_target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_login = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_private_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_share_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_ssh_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.num_shell_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.nvmet_port_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.report_discard_supported = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.reserved_percentage = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.scst_target_driver = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.storage_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.target_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.target_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.target_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.target_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.use_chap_auth = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volume_clear = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volume_clear_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] QuobyteHD.volumes_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack quobyte-client[86442]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack quobyte-client[86442]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_notifications.driver = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_notifications.retry = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] key_manager.fixed_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.barbican_api_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.barbican_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.barbican_endpoint_type = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.barbican_region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.number_of_retries = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.retry_delay = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.send_service_user_token = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.verify_ssl = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican.verify_ssl_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] CMD "mount.quobyte" returned: 1 in 0.136s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.auth_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86441]: INFO cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 ... Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f -c /etc/quobyte/client-cinder.cfg {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] barbican_service_user.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.approle_role_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.approle_secret_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.auth_method = approle {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.auth_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.kv_mountpoint = secret {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.kv_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.kv_version = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.root_token_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.token_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.token_role = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:01 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:37:01 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f -c /etc/quobyte/client-cinder.cfg Nov 06 21:37:01 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:01 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.475s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:01 devstack cinder-volume[86441]: INFO cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 succeeded Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.485s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:01 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:37:01 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:01 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.249s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:01 devstack cinder-volume[86441]: INFO cinder.volume.driver [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG cinder.volume.driver [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7164726257324, 'free_capacity_gb': 1773.7164726257324, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86441) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_db.sqlalchemy.engines [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG dbcounter [-] [86441] Writer thread running {{(pid=86441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG cinder.db.api [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Building query based on filter {{(pid=86441) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG cinder.image.image_utils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86441) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:37:01 devstack cinder-volume[86441]: INFO cinder.keymgr.migration [None req-b0818bd6-7a5f-4f48-9fdd-b8e1e2aa173d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:01 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:37:02 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.239s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG cinder.manager [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Notifying Schedulers of capabilities ... {{(pid=86441) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:02 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Driver initialization completed successfully. Nov 06 21:37:02 devstack cinder-volume[86441]: INFO cinder.manager [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Initiating service 3 cleanup Nov 06 21:37:02 devstack cinder-volume[86441]: INFO cinder.manager [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Service 3 cleanup completed. Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG cinder.service [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Creating RPC server for service cinder-volume {{(pid=86441) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG cinder.service [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86441) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:37:02 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:02 devstack sudo[86555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:37:02 devstack sudo[86555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:02 devstack sudo[86555]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:02 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.279s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:02 devstack cinder-volume[86441]: INFO cinder.volume.manager [None req-5484de4e-5a12-47b5-8e09-b82834b06bcb None None] Driver post RPC initialization completed successfully. Nov 06 21:37:07 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-56b8ad7e-8e09-427a-ab5d-d8a00b19acdf None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:07 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-56b8ad7e-8e09-427a-ab5d-d8a00b19acdf None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:07 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-56b8ad7e-8e09-427a-ab5d-d8a00b19acdf None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=86441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:07 devstack cinder-volume[86441]: DEBUG cinder.volume.drivers.quobyte [None req-56b8ad7e-8e09-427a-ab5d-d8a00b19acdf None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=86441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:07 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-56b8ad7e-8e09-427a-ab5d-d8a00b19acdf None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:07 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-56b8ad7e-8e09-427a-ab5d-d8a00b19acdf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:07 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:37:07 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:07 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:07 devstack cinder-volume[86441]: DEBUG oslo_concurrency.processutils [None req-56b8ad7e-8e09-427a-ab5d-d8a00b19acdf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.233s {{(pid=86441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:07 devstack cinder-volume[86441]: DEBUG cinder.manager [None req-56b8ad7e-8e09-427a-ab5d-d8a00b19acdf None None] Notifying Schedulers of capabilities ... {{(pid=86441) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:07 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Caught SIGTERM, stopping children Nov 06 21:37:07 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Acquiring lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:37:07 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Acquired lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:37:07 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Releasing lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:37:07 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Stop services. {{(pid=86223) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 21:37:07 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Killing children. {{(pid=86223) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 21:37:07 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Waiting on 1 children to exit Nov 06 21:37:10 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Acquiring lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:37:10 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Acquired lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:37:10 devstack cinder-volume[86441]: DEBUG oslo_concurrency.lockutils [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Releasing lock "singleton_lock" {{(pid=86441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:37:10 devstack cinder-volume[86441]: WARNING amqp [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:37:10 devstack cinder-volume[86441]: WARNING amqp [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 21:37:10 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-f833310d-9982-48e9-84b4-5f5091656c81 None None] Child 86441 exited with status 0 Nov 06 21:37:11 devstack cinder-volume[86759]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 21:37:11 devstack cinder-volume[86759]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:37:11 devstack cinder-volume[86759]: we strongly recommend against using it for new projects. Nov 06 21:37:11 devstack cinder-volume[86759]: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:37:11 devstack cinder-volume[86759]: framework. For more detail see Nov 06 21:37:11 devstack cinder-volume[86759]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:37:11 devstack cinder-volume[86759]: import eventlet # noqa Nov 06 21:37:14 devstack cinder-volume[86759]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86759) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 21:37:14 devstack cinder-volume[86759]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86759) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 21:37:14 devstack cinder-volume[86759]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86759) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 21:37:14 devstack cinder-volume[86759]: INFO dbcounter [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Registered counter for database cinder Nov 06 21:37:14 devstack cinder-volume[86759]: DEBUG oslo_db.sqlalchemy.engines [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86759) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG dbcounter [-] [86759] Writer thread running {{(pid=86759) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:37:15 devstack cinder-volume[86759]: INFO cinder.rpc [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 21:37:15 devstack cinder-volume[86759]: INFO cinder.rpc [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_db.sqlalchemy.engines [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86759) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:37:15 devstack cinder-volume[86759]: INFO cinder.volume.manager [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Determined volume DB was empty at startup. Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG cinder.volume.manager [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86759) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 21:37:15 devstack cinder-volume[86759]: WARNING stevedore.named [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:37:15 devstack cinder-volume[86759]: WARNING castellan.key_manager [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:37:15 devstack cinder-volume[86759]: WARNING cinder.keymgr.conf_key_mgr [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:37:15 devstack cinder-volume[86759]: INFO cinder.volume.manager [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_db.sqlalchemy.engines [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86759) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:37:15 devstack cinder-volume[86759]: INFO oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Starting 1 workers Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Started child 87069 {{(pid=86759) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Full set of CONF: {{(pid=86759) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] ******************************************************************************** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] Configuration options gathered from: {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] ================================================================================ {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] allow_availability_zone_fallback = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] allow_compression_on_image_upload = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] allowed_direct_url_schemes = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] api_rate_limit = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] auth_strategy = keystone {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_availability_zone = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_host = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[87069]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_stats_polling_interval = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backup_api_class = cinder.backup.api.API {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backup_name_template = backup-%s {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backup_use_same_host = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backup_use_temp_snapshot = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] chap_password = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] chap_username = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_internal_tenant_project_id = c612eef1f63041d49ebe535edccfaa2d {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_internal_tenant_user_id = 6736dc263b694097b8c399f33b96d838 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cluster = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] compression_format = gzip {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] compute_api_class = cinder.compute.nova.API {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] config_dir = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] config_source = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] control_exchange = openstack {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] debug = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] default_availability_zone = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] default_group_type = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] default_volume_type = QuobyteHD {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] disk_geometry = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] driver_client_cert = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] driver_client_cert_key = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] driver_data_namespace = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] driver_ssl_cert_path = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] driver_ssl_cert_verify = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] driver_use_ssl = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] enable_new_services = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] enable_unsupported_driver = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] enabled_backends = ['QuobyteHD'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] enforce_multipath_for_image_xfer = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] filter_function = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_api_insecure = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_api_servers = ['http://192.168.122.13/image'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_api_ssl_compression = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_ca_certificates_file = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_catalog_info = image:glance:publicURL {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_certfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_keyfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_num_retries = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance_request_timeout = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] goodness_function = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] graceful_shutdown_timeout = 5 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] group_api_class = cinder.group.api.API {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] host = devstack {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_compress_on_upload = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_conversion_address_space_limit = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_conversion_cpu_limit = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_conversion_disable = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_introspection_address_space_limit = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_introspection_cpu_limit = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_upload_use_cinder_backend = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_upload_use_internal_tenant = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_volume_cache_enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_volume_cache_max_count = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] image_volume_cache_max_size_gb = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] init_host_max_objects_retrieval = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] instance_format = [instance: %(uuid)s] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] iscsi_target_flags = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] iscsi_write_cache = on {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] iser_helper = tgtadm {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] iser_ip_address = 192.168.122.13 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] iser_port = 3260 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_color = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_config_append = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_dir = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_file = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_options = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_rotate_interval = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_rotate_interval_type = days {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] log_rotation_type = none {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] max_age = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] max_logfile_count = 30 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] max_logfile_size_mb = 200 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] max_over_subscription_ratio = 20.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] message_reap_interval = 86400 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] message_ttl = 2592000 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] migration_create_volume_timeout_secs = 300 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] monkey_patch = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] monkey_patch_modules = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] my_ip = 192.168.122.13 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] no_snapshot_gb_quota = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] num_iser_scan_tries = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] num_shell_tries = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] num_volume_device_scan_tries = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] nvmeof_conn_info_version = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] nvmet_ns_id = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] nvmet_port_id = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] osapi_max_limit = 1000 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] osapi_volume_ext_list = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] osapi_volume_listen_port = 8776 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] osapi_volume_use_ssl = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] osapi_volume_workers = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] per_volume_size_limit = -1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] periodic_fuzzy_delay = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] periodic_interval = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] public_endpoint = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87069) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] publish_errors = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] quota_backup_gigabytes = 1000 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] quota_backups = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] quota_gigabytes = 1000 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] quota_groups = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] quota_snapshots = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] quota_volumes = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] rate_limit_burst = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] rate_limit_except_level = CRITICAL {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] rate_limit_interval = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] reinit_driver_count = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] replication_device = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] report_discard_supported = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] report_interval = 120 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] reservation_clean_interval = 86400 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] reservation_expire = 86400 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] reserved_image_namespaces = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] reserved_percentage = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] rpc_response_timeout = 120 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] run_external_periodic_tasks = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] scst_target_driver = iscsi {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] scst_target_iqn_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_down_time = 720 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] shell_completion = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] snapshot_name_template = snapshot-%s {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] split_loggers = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] state_path = /opt/stack/data/cinder {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] storage_availability_zone = nova {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] storage_protocol = iSCSI {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] syslog_log_facility = LOG_USER {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] target_helper = lioadm {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] target_ip_address = 192.168.122.13 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] target_port = 3260 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] target_protocol = iscsi {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] target_secondary_ip_addresses = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] trace_flags = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] transport_url = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] until_refresh = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] use_chap_auth = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] use_default_quota_class = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] use_journal = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] use_json = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] use_multipath_for_image_xfer = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] use_stderr = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] use_syslog = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] verify_glance_signatures = enabled {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_api_class = cinder.volume.api.API {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_backend_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_clear = zero {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_clear_ionice = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_clear_size = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_copy_bps_limit = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_dd_blocksize = 1M {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_name_template = volume-%s {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_service_inithost_offload = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volume_usage_audit_period = month {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] zoning_mode = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_concurrency.disable_process_locking = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.auth_section = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.auth_type = password {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.auth_version = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.cache = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.certfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.include_service_catalog = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.insecure = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.interface = public {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.keyfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_password = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcache_username = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.region_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.service_type = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.13/identity {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.backend = dogpile.cache.null {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.backend_argument = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.backend_expiration_time = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.config_prefix = cache.oslo {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.debug_cache_backend = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.enable_retry_client = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.enable_socket_keepalive = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.expiration_time = 600 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.hashclient_retry_attempts = 2 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.memcache_dead_retry = 300 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.memcache_pool_maxsize = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.memcache_sasl_enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.password = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.proxies = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.redis_db = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.redis_server = localhost:6379 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.retry_attempts = 2 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.retry_delay = 0.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.socket_keepalive_count = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.socket_keepalive_idle = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.socket_keepalive_interval = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.socket_timeout = 1.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.tls_allowed_ciphers = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.tls_cafile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.tls_certfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.tls_enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.tls_keyfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cache.username = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] coordination.backend_url = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.asyncio_connection = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.asyncio_slave_connection = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.backend = sqlalchemy {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.connection = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87069) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.connection_debug = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.connection_parameters = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.connection_recycle_time = 3600 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.connection_trace = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.db_inc_retry_interval = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.db_max_retries = 20 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.db_max_retry_interval = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Running cmd (subprocess): mount.quobyte {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.db_retry_interval = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.max_overflow = 50 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.max_pool_size = 5 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.max_retries = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.mysql_wsrep_sync_wait = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.pool_timeout = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.retry_interval = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.slave_connection = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.sqlite_synchronous = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.synchronous_reader = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] database.use_db_reconnect = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_tracing.insecure = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.connection_string = messaging:// {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.es_doc_type = notification {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.es_scroll_size = 10000 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.es_scroll_time = 2m {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.filter_error_trace = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.hmac_keys = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.sentinel_service_name = mymaster {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.socket_timeout = 0.1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.trace_requests = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler.trace_sqlalchemy = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler_jaeger.process_tags = {} {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler_jaeger.service_name_prefix = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] profiler_otlp.service_name_prefix = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.enforce_new_defaults = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.policy_default_rule = default {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.policy_file = policy.yaml {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] privsep_osbrick.group = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] privsep_osbrick.helper_command = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] privsep_osbrick.user = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_sys_admin.group = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_sys_admin.helper_command = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] cinder_sys_admin.user = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.auth_section = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.auth_type = password {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.cafile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.certfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.collect_timing = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.insecure = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.keyfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.send_service_user_token = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.split_loggers = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.timeout = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.tls_ciphers = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] service_user.tls_min_version = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.auth_section = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.auth_type = password {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.certfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.collect_timing = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.insecure = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.keyfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.region_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.split_loggers = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.timeout = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.tls_ciphers = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] glance.tls_min_version = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.backend_availability_zone = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.chap_password = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.chap_username = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.disk_geometry = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.driver_client_cert = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.driver_client_cert_key = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.driver_data_namespace = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.driver_use_ssl = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.extra_capabilities = {} {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.filter_function = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.goodness_function = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.iscsi_target_flags = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.iscsi_write_cache = on {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.iser_helper = tgtadm {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.iser_ip_address = 192.168.122.13 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.iser_port = 3260 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_host = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_login = admin {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_mount_options = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_password = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_private_key = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_share_path = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.num_shell_tries = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.quobyte_volume_url = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.replication_device = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.report_discard_supported = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.reserved_percentage = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.target_helper = tgtadm {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.target_ip_address = 192.168.122.13 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.target_port = 3260 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.target_protocol = iscsi {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.trace_flags = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.unique_fqdn_network = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.use_chap_auth = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volume_backend_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volume_clear = zero {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volume_clear_ionice = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volume_clear_size = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_reports.file_event_handler = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_reports.log_dir = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack quobyte-client[87070]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 21:37:15 devstack quobyte-client[87070]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.backend_availability_zone = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.backend_host = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.chap_password = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.chap_username = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.chiscsi_conf = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.disk_geometry = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.driver_client_cert = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.driver_data_namespace = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.driver_use_ssl = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.extra_capabilities = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.filter_function = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.goodness_function = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.iser_helper = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.iser_ip_address = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.iser_port = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.iser_target_prefix = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_host = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_login = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_mount_options = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_password = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_private_key = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_share_path = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_ssh_port = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.num_shell_tries = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.nvmet_port_id = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.replication_device = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.report_discard_supported = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.reserved_percentage = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.scst_target_driver = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.storage_protocol = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.target_helper = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.target_ip_address = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.target_port = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.target_prefix = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.target_protocol = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.trace_flags = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.use_chap_auth = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volume_clear = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volume_clear_size = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] QuobyteHD.volumes_dir = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.ssl = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_notifications.driver = [] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_notifications.retry = -1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] key_manager.fixed_key = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.barbican_api_version = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.barbican_endpoint = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.barbican_endpoint_type = public {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.barbican_region_name = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.cafile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.certfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.collect_timing = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.insecure = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.keyfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.number_of_retries = 60 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.retry_delay = 1 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.send_service_user_token = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.split_loggers = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.timeout = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.tls_ciphers = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.tls_min_version = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.verify_ssl = True {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican.verify_ssl_path = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.auth_section = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.auth_type = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.cafile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.certfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.collect_timing = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.insecure = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.keyfile = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.split_loggers = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.timeout = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.tls_ciphers = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] barbican_service_user.tls_min_version = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.approle_role_id = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.approle_secret_id = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.auth_method = approle {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.auth_path = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.kv_mountpoint = secret {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.kv_path = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.kv_version = 2 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.namespace = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.root_token_id = **** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.ssl_ca_crt_file = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.timeout = 60.0 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.token_file = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.token_role = None {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.use_ssl = False {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 21:37:15 devstack cinder-volume[86759]: DEBUG oslo_service.backend._eventlet.service [None req-b3804964-1dd0-4b19-8af1-c861f477584f None None] ******************************************************************************** {{(pid=86759) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 21:37:15 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.227s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:15 devstack cinder-volume[87069]: INFO cinder.volume.driver [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Driver hasn't implemented _init_vendor_properties() Nov 06 21:37:15 devstack cinder-volume[87069]: DEBUG cinder.volume.driver [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7199096679688, 'free_capacity_gb': 1773.7199096679688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87069) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_db.sqlalchemy.engines [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87069) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writer thread running {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.db.api [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Building query based on filter {{(pid=87069) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87069) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1319}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:16 devstack cinder-volume[87069]: INFO cinder.keymgr.migration [None req-f4d0d6fa-9425-464d-ad45-e5169e71eaee None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 21:37:16 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:37:16 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:16 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.224s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:37:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Driver initialization completed successfully. Nov 06 21:37:16 devstack cinder-volume[87069]: INFO cinder.manager [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Initiating service 3 cleanup Nov 06 21:37:16 devstack cinder-volume[87069]: INFO cinder.manager [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Service 3 cleanup completed. Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.service [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Creating RPC server for service cinder-volume {{(pid=87069) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.service [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87069) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 21:37:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:37:16 devstack sudo[87093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:37:16 devstack sudo[87093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:37:16 devstack sudo[87093]: pam_unix(sudo:session): session closed for user root Nov 06 21:37:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:37:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6558ac3d-fd62-4e5e-ad73-88e5d2264486 None None] Driver post RPC initialization completed successfully. Nov 06 21:37:25 devstack cinder-volume[86759]: DEBUG dbcounter [-] [86759] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86759) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:26 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=4 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:26 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:37:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:37:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 6 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:37:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Flow 'volume_create_manager' (49161652-c2db-4b65-9430-6e36ce9f8660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef2e399-58c4-41f6-bb92-e4ac80afe146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ef2e399-58c4-41f6-bb92-e4ac80afe146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-220151550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb9b1e7-8d3f-4c41-ab1b-26963373be5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c973200582ee405fbcf814702146ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:14Z,use_quota=True,user_id='1748f7b57f414035805d79c6f692f780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aefd793-8f65-43e5-baa6-7487f47025c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aefd793-8f65-43e5-baa6-7487f47025c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c51bf6-5d3e-492f-a53b-d5d85e995feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c51bf6-5d3e-492f-a53b-d5d85e995feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb9b1e7-8d3f-4c41-ab1b-26963373be5b', 'volume_name': 'volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e134caa3-ee01-4c1c-914c-b54e8c16be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e134caa3-ee01-4c1c-914c-b54e8c16be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b296aa99-9cd7-4463-800e-c52c959094e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Volume 8cb9b1e7-8d3f-4c41-ab1b-26963373be5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b', 'volume_size': 1} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-220151550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb9b1e7-8d3f-4c41-ab1b-26963373be5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c973200582ee405fbcf814702146ff70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:14Z,use_quota=True,user_id='1748f7b57f414035805d79c6f692f780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Creating volume 8cb9b1e7-8d3f-4c41-ab1b-26963373be5b {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:14 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:38:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:14 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b 1073741824 Nov 06 21:38:14 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:15 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b 1073741824" returned: 0 in 0.687s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:15 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b Nov 06 21:38:15 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:15 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b" returned: 0 in 0.271s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b296aa99-9cd7-4463-800e-c52c959094e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1235a37c-9404-4a47-b557-17e2213c73b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:15 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Volume volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b (8cb9b1e7-8d3f-4c41-ab1b-26963373be5b): created successfully Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1235a37c-9404-4a47-b557-17e2213c73b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Flow 'volume_create_manager' (49161652-c2db-4b65-9430-6e36ce9f8660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:15 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c394713b-5b83-429e-9713-46637467362a tempest-TaggedAttachmentsTest-75761283 None] Created volume successfully. Nov 06 21:38:25 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:25 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Flow 'volume_create_manager' (35c6f576-ef3a-402c-89a0-617ad7de7eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ef5802-90e4-42bf-9248-749875cb18b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ef5802-90e4-42bf-9248-749875cb18b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2141551132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650deaa7-cff5-4e93-b0f6-9f7247e212de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d804d5540fc74ec092e810231b9c5381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:47Z,use_quota=True,user_id='89ee6ff1fff0452f98c4996640b59dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174fe37d-1609-45f6-bbc3-676875617a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (174fe37d-1609-45f6-bbc3-676875617a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82766e3a-204d-4755-9b2e-59303fc3d128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82766e3a-204d-4755-9b2e-59303fc3d128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650deaa7-cff5-4e93-b0f6-9f7247e212de', 'volume_name': 'volume-650deaa7-cff5-4e93-b0f6-9f7247e212de', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2740662-75ca-4db3-ac2a-93884576274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2740662-75ca-4db3-ac2a-93884576274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ec48e0-4ce1-4173-8316-cb7b7c540c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:46 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Volume 650deaa7-cff5-4e93-b0f6-9f7247e212de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650deaa7-cff5-4e93-b0f6-9f7247e212de', 'volume_size': 1} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2141551132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650deaa7-cff5-4e93-b0f6-9f7247e212de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d804d5540fc74ec092e810231b9c5381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:47Z,use_quota=True,user_id='89ee6ff1fff0452f98c4996640b59dee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Creating volume 650deaa7-cff5-4e93-b0f6-9f7247e212de {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:46 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:38:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:46 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de 1073741824 Nov 06 21:38:46 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:48 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de 1073741824" returned: 0 in 1.690s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:48 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de Nov 06 21:38:48 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:49 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de" returned: 0 in 0.526s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:38:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ec48e0-4ce1-4173-8316-cb7b7c540c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650deaa7-cff5-4e93-b0f6-9f7247e212de', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf5b17c-8d41-49bd-b114-3e4e5706bcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:49 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Volume volume-650deaa7-cff5-4e93-b0f6-9f7247e212de (650deaa7-cff5-4e93-b0f6-9f7247e212de): created successfully Nov 06 21:38:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bf5b17c-8d41-49bd-b114-3e4e5706bcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Flow 'volume_create_manager' (35c6f576-ef3a-402c-89a0-617ad7de7eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-09d96e9a-b612-4797-b3c7-28a2f7be8b00 tempest-VolumesAdminNegativeTest-679046980 None] Created volume successfully. Nov 06 21:38:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Acquiring lock "cinder-650deaa7-cff5-4e93-b0f6-9f7247e212de-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Lock "cinder-650deaa7-cff5-4e93-b0f6-9f7247e212de-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Acquiring lock "cinder-quobyte-650deaa7-cff5-4e93-b0f6-9f7247e212de" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:38:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Lock "cinder-quobyte-650deaa7-cff5-4e93-b0f6-9f7247e212de" acquired by "delete_volume" :: waited 0.047s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:38:51 devstack cinder-volume[87069]: INFO oslo.privsep.daemon [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4lp0huu2/privsep.sock'] Nov 06 21:38:51 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4lp0huu2/privsep.sock Nov 06 21:38:51 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 21:38:53 devstack cinder-volume[87069]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Flow 'volume_create_manager' (f865e56c-876c-49ac-8a94-5be2a7d450fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:53 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32bce700-e6d9-41fd-acb5-e133db8bd67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:53 devstack cinder-volume[87069]: INFO oslo.privsep.daemon [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Spawned new privsep daemon via rootwrap Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Accepted privsep connection to /tmp/tmp4lp0huu2/privsep.sock {{(pid=87069) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 21:38:53 devstack cinder-volume[87069]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 21:38:53 devstack cinder-volume[87069]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 21:38:53 devstack cinder-volume[87069]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 21:38:53 devstack cinder-volume[87069]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88361 Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87e4d2a-9fa1-4b74-8a4c-9fc58ed6a6e5]: (2,) {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32bce700-e6d9-41fd-acb5-e133db8bd67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-654736265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18818e7-51f2-4cc6-b4ef-d1f956791aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42b67c31bfe43e0a716cbd16b4d9078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:54Z,use_quota=True,user_id='9919e7db2bd04c1d8d503138bf6b767a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb9cc49-0949-4234-a258-21423f43db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb9cc49-0949-4234-a258-21423f43db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccdc0b1-b6bc-4297-bc5a-708636c7a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccdc0b1-b6bc-4297-bc5a-708636c7a26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18818e7-51f2-4cc6-b4ef-d1f956791aa8', 'volume_name': 'volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f75865d-69fc-46bc-8506-5f7309fc684f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f75865d-69fc-46bc-8506-5f7309fc684f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a95a3d-346a-4575-b659-51255db10bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Volume b18818e7-51f2-4cc6-b4ef-d1f956791aa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8', 'volume_size': 1} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-654736265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18818e7-51f2-4cc6-b4ef-d1f956791aa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a42b67c31bfe43e0a716cbd16b4d9078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:38:54Z,use_quota=True,user_id='9919e7db2bd04c1d8d503138bf6b767a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Creating volume b18818e7-51f2-4cc6-b4ef-d1f956791aa8 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:38:53 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:38:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7e88b-1cb9-4684-8714-8886dee5e7c0]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:38:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:54 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 1073741824 Nov 06 21:38:54 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:54 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de Nov 06 21:38:54 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:54 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de" returned: 0 in 0.889s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:54 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de Nov 06 21:38:55 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:55 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 1073741824" returned: 0 in 1.460s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:55 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 Nov 06 21:38:55 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:55 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-650deaa7-cff5-4e93-b0f6-9f7247e212de" returned: 0 in 0.909s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Lock "cinder-quobyte-650deaa7-cff5-4e93-b0f6-9f7247e212de" released by "delete_volume" :: held 4.746s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:56 devstack cinder-volume[87069]: WARNING cinder.quota [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:38:56 devstack cinder-volume[87069]: WARNING cinder.quota [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Created reservations ['a46e7330-8870-49b7-8e77-633e615893fa', '4ebbba40-1eb6-409e-9f8a-f4d6a1b883f8', 'f7db8b68-632e-4f27-886c-89a8ad14d30b', '2bc5a04c-4882-420d-a2cc-a876cf1e247d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:38:56 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8" returned: 0 in 0.569s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a95a3d-346a-4575-b659-51255db10bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ea6510-6aa2-45f5-a3d8-5b8371ad6e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:56 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Volume volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 (b18818e7-51f2-4cc6-b4ef-d1f956791aa8): created successfully Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ea6510-6aa2-45f5-a3d8-5b8371ad6e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:38:56 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Flow 'volume_create_manager' (f865e56c-876c-49ac-8a94-5be2a7d450fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:38:56 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-90062f2a-b4c1-4118-90d4-d0bfe811e869 tempest-ServerRescueNegativeTestJSON-1460375571 None] Created volume successfully. Nov 06 21:38:56 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.511s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Deleted volume successfully. Nov 06 21:38:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-afa3289c-6e0a-46e2-91bb-bf094f63f61c tempest-VolumesAdminNegativeTest-679046980 None] Lock "cinder-650deaa7-cff5-4e93-b0f6-9f7247e212de-delete_volume" released by "delete_volume" :: held 5.959s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:38:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:38:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:38:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:38:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:38:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:38:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:38:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:38:58 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:38:58 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:38:59 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Nov 06 21:38:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.441s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:38:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:38:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:38:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 8 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:38:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:39:06 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=17,cinder:SELECT=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:39:06 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:39:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Acquiring lock "cinder-b18818e7-51f2-4cc6-b4ef-d1f956791aa8-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:39:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "cinder-b18818e7-51f2-4cc6-b4ef-d1f956791aa8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:39:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Acquiring lock "cinder-quobyte-b18818e7-51f2-4cc6-b4ef-d1f956791aa8" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:39:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "cinder-quobyte-b18818e7-51f2-4cc6-b4ef-d1f956791aa8" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:39:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d341874-9bb1-4023-bdac-7f82decbad8d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:39:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:39:16 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 Nov 06 21:39:16 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:39:17 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8" returned: 0 in 0.585s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:39:17 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8 Nov 06 21:39:17 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:39:17 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b18818e7-51f2-4cc6-b4ef-d1f956791aa8" returned: 0 in 0.364s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "cinder-quobyte-b18818e7-51f2-4cc6-b4ef-d1f956791aa8" released by "delete_volume" :: held 1.049s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Created reservations ['d6787e33-e41c-4635-8119-74de61243270', '420dba4c-4887-4308-94a2-6879edf4718a', '30a14b30-83b5-457b-b221-47b7ad67a907', '3f623590-a505-4022-a13f-ac7e870ef05f'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:39:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:39:17 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:39:17 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:39:18 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Nov 06 21:39:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.412s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:39:18 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:39:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Deleted volume successfully. Nov 06 21:39:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-840a1ce7-f3c7-4e75-bd00-27a1c41e1be9 tempest-ServerRescueNegativeTestJSON-1460375571 None] Lock "cinder-b18818e7-51f2-4cc6-b4ef-d1f956791aa8-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:39:27 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:39:28 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:39:57 devstack cinder-volume[87069]: WARNING py.warnings [req-36ae65e7-b4fe-4c7c-8db1-78c1026750c6 req-53726bc1-a953-47df-bb2f-03843d61e0e1 tempest-TaggedAttachmentsTest-75761283 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 06 21:39:57 devstack cinder-volume[87069]: .first() Nov 06 21:39:57 devstack cinder-volume[87069]: Nov 06 21:39:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-36ae65e7-b4fe-4c7c-8db1-78c1026750c6 req-53726bc1-a953-47df-bb2f-03843d61e0e1 tempest-TaggedAttachmentsTest-75761283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:39:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-36ae65e7-b4fe-4c7c-8db1-78c1026750c6 req-53726bc1-a953-47df-bb2f-03843d61e0e1 tempest-TaggedAttachmentsTest-75761283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-36ae65e7-b4fe-4c7c-8db1-78c1026750c6 req-53726bc1-a953-47df-bb2f-03843d61e0e1 tempest-TaggedAttachmentsTest-75761283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.130s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-36ae65e7-b4fe-4c7c-8db1-78c1026750c6 req-53726bc1-a953-47df-bb2f-03843d61e0e1 tempest-TaggedAttachmentsTest-75761283 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddaadb98-52a5-40d9-af0a-fb8f9cfb935e', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:39:58 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-36ae65e7-b4fe-4c7c-8db1-78c1026750c6 req-53726bc1-a953-47df-bb2f-03843d61e0e1 tempest-TaggedAttachmentsTest-75761283 None] attachment_update completed successfully. Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:39:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:39:58 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:39:58 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:39:59 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Nov 06 21:39:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.812s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:39:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Flow 'volume_create_manager' (8f04e5d5-7c82-4d31-ab54-7c5aa4ee79ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c21ea4-2107-41b0-816c-2f99b3babd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c21ea4-2107-41b0-816c-2f99b3babd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-497698600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e48603d-1f44-40e6-87b5-62b0ef440261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82605d3c9084bb9aeeaaa7dfadfbf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:03Z,use_quota=True,user_id='7790be6244d9442c8dc8f1bb35cd9046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181b6ee1-a32d-4771-a6ac-015d66c2a3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181b6ee1-a32d-4771-a6ac-015d66c2a3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabafdea-bbc4-40bd-b2ab-41761a20e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabafdea-bbc4-40bd-b2ab-41761a20e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e48603d-1f44-40e6-87b5-62b0ef440261', 'volume_name': 'volume-3e48603d-1f44-40e6-87b5-62b0ef440261', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7591e3-c2d3-43d1-94c0-4e8e59453937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7591e3-c2d3-43d1-94c0-4e8e59453937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5183d9a2-e21f-4b12-b7c7-9e6c3ec72f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:03 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Volume 3e48603d-1f44-40e6-87b5-62b0ef440261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e48603d-1f44-40e6-87b5-62b0ef440261', 'volume_size': 1} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-497698600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e48603d-1f44-40e6-87b5-62b0ef440261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82605d3c9084bb9aeeaaa7dfadfbf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:03Z,use_quota=True,user_id='7790be6244d9442c8dc8f1bb35cd9046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Creating volume 3e48603d-1f44-40e6-87b5-62b0ef440261 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:40:03 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:03 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 1073741824 Nov 06 21:40:03 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-e3feeb6b-918b-4424-a9d4-8a828d98950b req-61b1dafd-96f3-4384-8db6-d790ac9008f7 tempest-TaggedAttachmentsTest-75761283 None] Terminate volume connection completed successfully. Nov 06 21:40:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-e3feeb6b-918b-4424-a9d4-8a828d98950b req-61b1dafd-96f3-4384-8db6-d790ac9008f7 tempest-TaggedAttachmentsTest-75761283 None] Deleting attachment ddaadb98-52a5-40d9-af0a-fb8f9cfb935e. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:40:04 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 1073741824" returned: 0 in 0.918s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:04 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 Nov 06 21:40:04 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261" returned: 0 in 0.827s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] <== create_volume: return (1878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:40:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:05 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5183d9a2-e21f-4b12-b7c7-9e6c3ec72f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e48603d-1f44-40e6-87b5-62b0ef440261', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ed4e34-a90b-48fc-b301-92576292984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:05 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Volume volume-3e48603d-1f44-40e6-87b5-62b0ef440261 (3e48603d-1f44-40e6-87b5-62b0ef440261): created successfully Nov 06 21:40:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ed4e34-a90b-48fc-b301-92576292984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Flow 'volume_create_manager' (8f04e5d5-7c82-4d31-ab54-7c5aa4ee79ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:05 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fe7be526-a879-4925-aa2d-f480aa28b6ab tempest-AttachVolumeTestJSON-1944334825 None] Created volume successfully. Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Flow 'volume_create_manager' (58379835-7eef-4ee0-9714-91c74a07cf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760fb62b-1720-4669-b9cc-3ed27972a174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760fb62b-1720-4669-b9cc-3ed27972a174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1382816210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc10d59-1bcf-4726-a646-1d42654829e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e25bc712c6d4a45a04fc162fb1397a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:09Z,use_quota=True,user_id='f0ec40ef6f4a40318d6c071942a45aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c271d283-d4fd-4aea-beb8-7455f4054dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c271d283-d4fd-4aea-beb8-7455f4054dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b686ed4-6d62-4ea0-b0fb-a86f2d01a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b686ed4-6d62-4ea0-b0fb-a86f2d01a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc10d59-1bcf-4726-a646-1d42654829e9', 'volume_name': 'volume-3bc10d59-1bcf-4726-a646-1d42654829e9', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd20b93-e5fa-4038-a52e-0622c1a724e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd20b93-e5fa-4038-a52e-0622c1a724e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d022ee-4260-4bc1-8309-a66f6fe17155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:08 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Volume 3bc10d59-1bcf-4726-a646-1d42654829e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc10d59-1bcf-4726-a646-1d42654829e9', 'volume_size': 1} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1382816210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc10d59-1bcf-4726-a646-1d42654829e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e25bc712c6d4a45a04fc162fb1397a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:09Z,use_quota=True,user_id='f0ec40ef6f4a40318d6c071942a45aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:40:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Creating volume 3bc10d59-1bcf-4726-a646-1d42654829e9 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:40:09 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:09 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 1073741824 Nov 06 21:40:09 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-375c31a0-f217-448a-a129-6c11b4391455 req-eeb9fbca-88d5-4157-87b4-a616682d3228 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:09 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 1073741824" returned: 0 in 0.802s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:10 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 Nov 06 21:40:10 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:10 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9" returned: 0 in 0.868s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-375c31a0-f217-448a-a129-6c11b4391455 req-eeb9fbca-88d5-4157-87b4-a616682d3228 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.157s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d022ee-4260-4bc1-8309-a66f6fe17155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc10d59-1bcf-4726-a646-1d42654829e9', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119fd6f5-f181-42d4-83ba-80c095d02753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-375c31a0-f217-448a-a129-6c11b4391455 req-eeb9fbca-88d5-4157-87b4-a616682d3228 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.095s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:10 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Volume volume-3bc10d59-1bcf-4726-a646-1d42654829e9 (3bc10d59-1bcf-4726-a646-1d42654829e9): created successfully Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119fd6f5-f181-42d4-83ba-80c095d02753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Flow 'volume_create_manager' (58379835-7eef-4ee0-9714-91c74a07cf4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a742ec2c-9d5b-4c60-8329-54c7148ae07a tempest-DeleteServersTestJSON-631114977 None] Created volume successfully. Nov 06 21:40:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-375c31a0-f217-448a-a129-6c11b4391455 req-eeb9fbca-88d5-4157-87b4-a616682d3228 tempest-AttachVolumeTestJSON-1944334825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-3e48603d-1f44-40e6-87b5-62b0ef440261', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b45caab-b4c9-49da-b131-2dd4f38f3746', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:40:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-375c31a0-f217-448a-a129-6c11b4391455 req-eeb9fbca-88d5-4157-87b4-a616682d3228 tempest-AttachVolumeTestJSON-1944334825 None] attachment_update completed successfully. Nov 06 21:40:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1c568c2b-b7da-4bf3-a3ad-64998124579a req-dbfdf0fe-e4fe-40db-a18e-803cabfcdb66 tempest-DeleteServersTestJSON-631114977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1c568c2b-b7da-4bf3-a3ad-64998124579a req-dbfdf0fe-e4fe-40db-a18e-803cabfcdb66 tempest-DeleteServersTestJSON-631114977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1c568c2b-b7da-4bf3-a3ad-64998124579a req-dbfdf0fe-e4fe-40db-a18e-803cabfcdb66 tempest-DeleteServersTestJSON-631114977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-1c568c2b-b7da-4bf3-a3ad-64998124579a req-dbfdf0fe-e4fe-40db-a18e-803cabfcdb66 tempest-DeleteServersTestJSON-631114977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-3bc10d59-1bcf-4726-a646-1d42654829e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f022adf-ee83-4e53-ab20-bad6325d42e1', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:40:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-1c568c2b-b7da-4bf3-a3ad-64998124579a req-dbfdf0fe-e4fe-40db-a18e-803cabfcdb66 tempest-DeleteServersTestJSON-631114977 None] attachment_update completed successfully. Nov 06 21:40:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-0a74793d-e868-4ce4-8ee1-e83b4d51fbcc req-b74ac59d-50c5-4680-9b96-a1b681de5edd tempest-DeleteServersTestJSON-631114977 None] Terminate volume connection completed successfully. Nov 06 21:40:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-0a74793d-e868-4ce4-8ee1-e83b4d51fbcc req-b74ac59d-50c5-4680-9b96-a1b681de5edd tempest-DeleteServersTestJSON-631114977 None] Deleting attachment 2f022adf-ee83-4e53-ab20-bad6325d42e1. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:40:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Acquiring lock "cinder-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Lock "cinder-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Acquiring lock "cinder-3bc10d59-1bcf-4726-a646-1d42654829e9-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Acquiring lock "cinder-quobyte-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Lock "cinder-3bc10d59-1bcf-4726-a646-1d42654829e9-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Lock "cinder-quobyte-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b" acquired by "delete_volume" :: waited 0.094s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8637aacc-a31d-4515-9353-bbd1e1b46229]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Acquiring lock "cinder-quobyte-3bc10d59-1bcf-4726-a646-1d42654829e9" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Lock "cinder-quobyte-3bc10d59-1bcf-4726-a646-1d42654829e9" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb9414f-d69c-4a14-a641-f868dc615f6d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:40:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:23 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 Nov 06 21:40:23 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:23 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b Nov 06 21:40:23 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:24 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9" returned: 0 in 0.911s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:24 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b" returned: 0 in 1.153s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:24 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9 Nov 06 21:40:24 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:24 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b Nov 06 21:40:24 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:24 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3bc10d59-1bcf-4726-a646-1d42654829e9" returned: 0 in 0.568s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Lock "cinder-quobyte-3bc10d59-1bcf-4726-a646-1d42654829e9" released by "delete_volume" :: held 1.598s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:25 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b" returned: 0 in 0.605s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Created reservations ['0f7a3da4-cb4e-4652-8aaa-ffc704092602', 'a82f7f1c-fef9-42a5-a66e-0123b7df5b0d', 'b0dc92dd-5b2c-428f-801b-f294d81742c1', '2532bca7-c4d9-4aa2-a5a6-33fc62e94b80'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Lock "cinder-quobyte-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b" released by "delete_volume" :: held 1.908s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:25 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:40:25 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Created reservations ['91edef0c-6ed3-4eb6-9a38-5fb2587c73f4', 'efcd7d80-18b4-492e-863e-b22b1027d886', '3e74957f-4dc4-466f-869d-2c4b28628666', '9569eda3-8b83-47ac-ad15-c14b3321afe9'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:25 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:40:25 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:25 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.608s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:25 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Deleted volume successfully. Nov 06 21:40:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-96769dd0-eb09-45c4-bce4-2a68d460e5b4 tempest-DeleteServersTestJSON-631114977 None] Lock "cinder-3bc10d59-1bcf-4726-a646-1d42654829e9-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:26 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.700s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:26 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Deleted volume successfully. Nov 06 21:40:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3dca2d5e-dca6-42c6-8a07-06a9d71efc1d tempest-TaggedAttachmentsTest-75761283 None] Lock "cinder-8cb9b1e7-8d3f-4c41-ab1b-26963373be5b-delete_volume" released by "delete_volume" :: held 3.468s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Flow 'volume_create_manager' (da6811f5-28a0-492f-9e32-550c0c010db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9130e4c-d5f6-4123-bce0-333ea48ec39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9130e4c-d5f6-4123-bce0-333ea48ec39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2117333455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87317dd6-cb58-4c4b-921b-7b192ebd8bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cade5e0eeb2948428f7ad39d1145ff46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:32Z,use_quota=True,user_id='ad833beea36c42339badb3c26e425c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1438778-2fa4-4a78-9b28-1398429963c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1438778-2fa4-4a78-9b28-1398429963c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a1a524-c921-411f-a8a9-579f3923b5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50a1a524-c921-411f-a8a9-579f3923b5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87317dd6-cb58-4c4b-921b-7b192ebd8bb5', 'volume_name': 'volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b487a799-2e13-4a69-96cf-89150bdbff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b487a799-2e13-4a69-96cf-89150bdbff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d739ad-6d83-4dc4-86fb-20a375590876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Volume 87317dd6-cb58-4c4b-921b-7b192ebd8bb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5', 'volume_size': 1} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2117333455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87317dd6-cb58-4c4b-921b-7b192ebd8bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cade5e0eeb2948428f7ad39d1145ff46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:32Z,use_quota=True,user_id='ad833beea36c42339badb3c26e425c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Creating volume 87317dd6-cb58-4c4b-921b-7b192ebd8bb5 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:40:32 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:40:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:32 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 1073741824 Nov 06 21:40:32 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:32 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 1073741824" returned: 0 in 0.584s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:33 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 Nov 06 21:40:33 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:33 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d739ad-6d83-4dc4-86fb-20a375590876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1c82c3-870d-409e-bee0-9e53839979b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:33 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Volume volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 (87317dd6-cb58-4c4b-921b-7b192ebd8bb5): created successfully Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1c82c3-870d-409e-bee0-9e53839979b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Flow 'volume_create_manager' (da6811f5-28a0-492f-9e32-550c0c010db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:33 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a7ddf0f3-364d-4e51-9160-7a236e3b9d52 tempest-ServersNegativeTestJSON-1526888914 None] Created volume successfully. Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Flow 'volume_create_manager' (c23e7c9e-f991-4ef5-b72b-6816348b4972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4166e8c-5d8e-4102-ae4f-39dab0935671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4166e8c-5d8e-4102-ae4f-39dab0935671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1421831860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c284011-85f6-4158-ab6c-8d5362c02f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cade5e0eeb2948428f7ad39d1145ff46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:36Z,use_quota=True,user_id='ad833beea36c42339badb3c26e425c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1519bc1c-63b9-4f75-ab9d-3644dbe7e9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1519bc1c-63b9-4f75-ab9d-3644dbe7e9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb7bf0a-f661-4350-801f-48ef877a9531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb7bf0a-f661-4350-801f-48ef877a9531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c284011-85f6-4158-ab6c-8d5362c02f20', 'volume_name': 'volume-9c284011-85f6-4158-ab6c-8d5362c02f20', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be92c335-42b7-4f9c-afd9-0dba2b8dc39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be92c335-42b7-4f9c-afd9-0dba2b8dc39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be69944-6473-451f-af4c-1816fbd199e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:36 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Volume 9c284011-85f6-4158-ab6c-8d5362c02f20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c284011-85f6-4158-ab6c-8d5362c02f20', 'volume_size': 1} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1421831860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c284011-85f6-4158-ab6c-8d5362c02f20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cade5e0eeb2948428f7ad39d1145ff46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:36Z,use_quota=True,user_id='ad833beea36c42339badb3c26e425c9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Creating volume 9c284011-85f6-4158-ab6c-8d5362c02f20 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:40:36 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:36 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 1073741824 Nov 06 21:40:36 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:36 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 1073741824" returned: 0 in 0.639s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:37 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 Nov 06 21:40:37 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Flow 'volume_create_manager' (242297c8-c2db-4682-a502-e7b6506dae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd46d8e-9b7d-4870-9fcd-a49832153325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd46d8e-9b7d-4870-9fcd-a49832153325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1978215600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea4596223d214bbc999e2f2290aa2b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:37Z,use_quota=True,user_id='2d1622e260f24b85be67a8952079c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74590b8f-b388-483e-b2a6-2f4e2c0fa610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74590b8f-b388-483e-b2a6-2f4e2c0fa610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5e2af3-7e43-4e88-a0b1-dc217a772788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5e2af3-7e43-4e88-a0b1-dc217a772788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f', 'volume_name': 'volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb250819-2a2c-48e7-9ff7-0dc94d0d0a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb250819-2a2c-48e7-9ff7-0dc94d0d0a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed71b8ea-b2c7-43e2-8b15-f04a00dfa3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:37 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Volume 7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f', 'volume_size': 1} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:37 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20" returned: 0 in 0.306s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1978215600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea4596223d214bbc999e2f2290aa2b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:37Z,use_quota=True,user_id='2d1622e260f24b85be67a8952079c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Creating volume 7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:40:37 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be69944-6473-451f-af4c-1816fbd199e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c284011-85f6-4158-ab6c-8d5362c02f20', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:37 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f 1073741824 Nov 06 21:40:37 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5265e01-5b1f-4886-be53-8a7aa0e78fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:37 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Volume volume-9c284011-85f6-4158-ab6c-8d5362c02f20 (9c284011-85f6-4158-ab6c-8d5362c02f20): created successfully Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5265e01-5b1f-4886-be53-8a7aa0e78fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Flow 'volume_create_manager' (c23e7c9e-f991-4ef5-b72b-6816348b4972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6db716a4-76c2-4326-8006-7975933a9b7e tempest-ServersNegativeTestJSON-1526888914 None] Created volume successfully. Nov 06 21:40:37 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f 1073741824" returned: 0 in 0.443s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:37 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f Nov 06 21:40:37 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:38 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f" returned: 0 in 0.383s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed71b8ea-b2c7-43e2-8b15-f04a00dfa3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01fbd9f-2436-48db-abcf-fc88039e48cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:38 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Volume volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f (7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f): created successfully Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01fbd9f-2436-48db-abcf-fc88039e48cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Flow 'volume_create_manager' (242297c8-c2db-4682-a502-e7b6506dae36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6fb242ba-8597-41b4-af6c-4df4d2500813 tempest-VolumesTestJSON-1573543257 None] Created volume successfully. Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "cinder-9c284011-85f6-4158-ab6c-8d5362c02f20-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Lock "cinder-9c284011-85f6-4158-ab6c-8d5362c02f20-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "cinder-quobyte-9c284011-85f6-4158-ab6c-8d5362c02f20" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Lock "cinder-quobyte-9c284011-85f6-4158-ab6c-8d5362c02f20" acquired by "delete_volume" :: waited 0.038s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[77be09b9-a53b-475a-b220-4206cf531b76]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:40:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:39 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 Nov 06 21:40:39 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:39 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20" returned: 0 in 0.564s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:39 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20 Nov 06 21:40:39 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:39 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9c284011-85f6-4158-ab6c-8d5362c02f20" returned: 0 in 0.372s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Lock "cinder-quobyte-9c284011-85f6-4158-ab6c-8d5362c02f20" released by "delete_volume" :: held 1.012s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:39 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Created reservations ['a0820868-da42-4049-8d44-0958ad95f27b', '518d1bd0-e234-4cdf-a2bd-b8d685b278a4', '951426be-2c5b-44e8-89a5-08f17f7b0381', 'edccce66-7967-4090-872d-026d3beb2fb4'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:40:39 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Flow 'volume_create_manager' (7faa7a4c-bcab-4451-8069-f122de491740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f59ee52-2cf9-4582-baf7-56baef4922cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f59ee52-2cf9-4582-baf7-56baef4922cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2121569835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76122e48-f246-4ea5-8292-e12c1d8aeac8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea4596223d214bbc999e2f2290aa2b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:40Z,use_quota=True,user_id='2d1622e260f24b85be67a8952079c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df865ba-c3f2-4bc4-aa79-02ac02aa5f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df865ba-c3f2-4bc4-aa79-02ac02aa5f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccef8f1-c1d7-4883-84cf-c106753644e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccef8f1-c1d7-4883-84cf-c106753644e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76122e48-f246-4ea5-8292-e12c1d8aeac8', 'volume_name': 'volume-76122e48-f246-4ea5-8292-e12c1d8aeac8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ce6fce-4b70-499d-9be7-b3c72a8a00a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ce6fce-4b70-499d-9be7-b3c72a8a00a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abecb770-d33e-4884-afa3-17de05c48174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:40 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Volume 76122e48-f246-4ea5-8292-e12c1d8aeac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76122e48-f246-4ea5-8292-e12c1d8aeac8', 'volume_size': 1} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2121569835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76122e48-f246-4ea5-8292-e12c1d8aeac8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea4596223d214bbc999e2f2290aa2b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:40Z,use_quota=True,user_id='2d1622e260f24b85be67a8952079c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Creating volume 76122e48-f246-4ea5-8292-e12c1d8aeac8 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:40:40 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:40 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 1073741824 Nov 06 21:40:40 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:40 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:40:40 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:40 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.377s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:40 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Deleted volume successfully. Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a428fdf-b3d5-4060-866c-93ea0dae5371 tempest-ServersNegativeTestJSON-1526888914 None] Lock "cinder-9c284011-85f6-4158-ab6c-8d5362c02f20-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:40 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 1073741824" returned: 0 in 0.578s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:40 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 Nov 06 21:40:40 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:40 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8" returned: 0 in 0.292s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abecb770-d33e-4884-afa3-17de05c48174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76122e48-f246-4ea5-8292-e12c1d8aeac8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e929611f-213b-4422-9ada-eae6610d26d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "cinder-87317dd6-cb58-4c4b-921b-7b192ebd8bb5-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:41 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Volume volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 (76122e48-f246-4ea5-8292-e12c1d8aeac8): created successfully Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e929611f-213b-4422-9ada-eae6610d26d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Flow 'volume_create_manager' (7faa7a4c-bcab-4451-8069-f122de491740) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Lock "cinder-87317dd6-cb58-4c4b-921b-7b192ebd8bb5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:41 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-196baa36-21f8-48c0-a942-df49d382c93d tempest-VolumesTestJSON-1573543257 None] Created volume successfully. Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "cinder-quobyte-87317dd6-cb58-4c4b-921b-7b192ebd8bb5" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Lock "cinder-quobyte-87317dd6-cb58-4c4b-921b-7b192ebd8bb5" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f42615-6dbd-4b21-b49b-06b64f26c677]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:41 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 Nov 06 21:40:41 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:41 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5" returned: 0 in 0.394s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:41 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5 Nov 06 21:40:41 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:41 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-87317dd6-cb58-4c4b-921b-7b192ebd8bb5" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Lock "cinder-quobyte-87317dd6-cb58-4c4b-921b-7b192ebd8bb5" released by "delete_volume" :: held 0.695s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Created reservations ['bf657379-4027-4e67-b942-7fd278a9b2fb', 'c5f8b174-d18f-46f5-926a-ad0413382298', 'e51d2aa3-596f-4ec4-b348-74c4310ec64d', '3035ec75-26a0-4bb5-89dc-242d04de43a7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:42 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:40:42 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:42 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.312s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:42 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Deleted volume successfully. Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-019d219c-bc62-440d-bf33-1f652d36e472 tempest-ServersNegativeTestJSON-1526888914 None] Lock "cinder-87317dd6-cb58-4c4b-921b-7b192ebd8bb5-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Flow 'volume_create_manager' (b1b68681-87bb-49b8-a3fd-b60eb2984cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4bcf76-f61a-4b7d-a599-b9ff71bdbd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4bcf76-f61a-4b7d-a599-b9ff71bdbd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1537019132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e961fbad-c4dd-46b5-ba1d-529d225a32e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea4596223d214bbc999e2f2290aa2b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:43Z,use_quota=True,user_id='2d1622e260f24b85be67a8952079c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5da1ef-307b-419f-b8be-5b28198c4bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5da1ef-307b-419f-b8be-5b28198c4bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31b9987-327b-4071-979f-59145640f040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31b9987-327b-4071-979f-59145640f040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e961fbad-c4dd-46b5-ba1d-529d225a32e0', 'volume_name': 'volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c61f04c-7aa6-4fc1-91a1-71f03782ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c61f04c-7aa6-4fc1-91a1-71f03782ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69145526-e375-428e-b05b-59245c613871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:42 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Volume e961fbad-c4dd-46b5-ba1d-529d225a32e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0', 'volume_size': 1} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1537019132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e961fbad-c4dd-46b5-ba1d-529d225a32e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ea4596223d214bbc999e2f2290aa2b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:40:43Z,use_quota=True,user_id='2d1622e260f24b85be67a8952079c4f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Creating volume e961fbad-c4dd-46b5-ba1d-529d225a32e0 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:40:42 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:40:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:42 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 1073741824 Nov 06 21:40:42 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:43 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 1073741824" returned: 0 in 0.699s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:43 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 Nov 06 21:40:43 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:43 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0" returned: 0 in 0.318s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69145526-e375-428e-b05b-59245c613871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f41202d-f5bc-49bb-9e69-72662b0a2422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:40:43 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Volume volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 (e961fbad-c4dd-46b5-ba1d-529d225a32e0): created successfully Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f41202d-f5bc-49bb-9e69-72662b0a2422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:40:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Flow 'volume_create_manager' (b1b68681-87bb-49b8-a3fd-b60eb2984cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:40:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-3ab46566-8188-47bf-85a7-042564c759ef tempest-VolumesTestJSON-1573543257 None] Created volume successfully. Nov 06 21:40:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Acquiring lock "cinder-e961fbad-c4dd-46b5-ba1d-529d225a32e0-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Lock "cinder-e961fbad-c4dd-46b5-ba1d-529d225a32e0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Acquiring lock "cinder-quobyte-e961fbad-c4dd-46b5-ba1d-529d225a32e0" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Lock "cinder-quobyte-e961fbad-c4dd-46b5-ba1d-529d225a32e0" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf35208a-57ac-4b41-be62-9fcc09f99200]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:40:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:46 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 Nov 06 21:40:46 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:46 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0" returned: 0 in 0.411s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:46 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0 Nov 06 21:40:46 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:46 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e961fbad-c4dd-46b5-ba1d-529d225a32e0" returned: 0 in 0.327s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Lock "cinder-quobyte-e961fbad-c4dd-46b5-ba1d-529d225a32e0" released by "delete_volume" :: held 0.792s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Created reservations ['547133a3-ec10-4ed2-ba57-58f35c1aefa6', 'b12690c2-a6ed-40e3-be89-d3c92a06ff4a', '60fe3b43-c3ee-4e50-ab65-fc8ab916af1b', '3cf865eb-c222-4c65-86b9-95416f597a1e'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:46 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:40:46 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Acquiring lock "cinder-76122e48-f246-4ea5-8292-e12c1d8aeac8-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Lock "cinder-76122e48-f246-4ea5-8292-e12c1d8aeac8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Acquiring lock "cinder-quobyte-76122e48-f246-4ea5-8292-e12c1d8aeac8" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Lock "cinder-quobyte-76122e48-f246-4ea5-8292-e12c1d8aeac8" acquired by "delete_volume" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[05288ac9-248d-4e1a-82be-a60f1cbb277a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:47 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Deleted volume successfully. Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-00ccfb86-1033-42e4-9d42-b12019f18838 tempest-VolumesTestJSON-1573543257 None] Lock "cinder-e961fbad-c4dd-46b5-ba1d-529d225a32e0-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:47 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 Nov 06 21:40:47 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:47 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8" returned: 0 in 0.447s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:47 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8 Nov 06 21:40:47 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:47 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-76122e48-f246-4ea5-8292-e12c1d8aeac8" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Lock "cinder-quobyte-76122e48-f246-4ea5-8292-e12c1d8aeac8" released by "delete_volume" :: held 0.771s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Created reservations ['9dfd9e0d-c958-4549-846f-18b0e16b6a70', 'f8d914bc-593d-4906-b5b5-e9136dd07632', '607e9e4f-54e5-492e-959f-a524a6bf63c2', 'd4316ff1-7e91-47d7-a75a-6edf9d7406ef'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:48 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:40:48 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Acquiring lock "cinder-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Lock "cinder-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=67,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=15 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:40:48 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.305s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Acquiring lock "cinder-quobyte-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:40:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Deleted volume successfully. Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Lock "cinder-quobyte-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c25e8899-dd08-41f9-957c-2a9212f7f0ac tempest-VolumesTestJSON-1573543257 None] Lock "cinder-76122e48-f246-4ea5-8292-e12c1d8aeac8-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9225825-cfe8-4c47-af3b-4d159fba054e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:48 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f Nov 06 21:40:48 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:48 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f" returned: 0 in 0.488s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:48 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f Nov 06 21:40:48 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:49 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f" returned: 0 in 0.327s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Lock "cinder-quobyte-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f" released by "delete_volume" :: held 0.890s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Created reservations ['39f27f82-cc96-4972-9d11-cdc80e484781', 'a347492e-5b90-40e7-9f62-80c4942eb559', 'fffef980-df85-4eef-8f1c-2a1e6768213b', 'edc7bb45-17c0-4af3-b735-9d67c4def0cf'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:49 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:40:49 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:49 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:49 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Deleted volume successfully. Nov 06 21:40:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e15c7a0-ec06-48dc-99d9-e4e88d4033ca tempest-VolumesTestJSON-1573543257 None] Lock "cinder-7b5a2cfd-a5c0-4a51-b2a0-68b4bc97640f-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:40:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-16af73ef-f598-4097-b429-2f6ba4e8566b req-89e6a4f0-2c27-4015-8495-df3b96acbe00 tempest-AttachVolumeTestJSON-1944334825 None] Terminate volume connection completed successfully. Nov 06 21:40:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-16af73ef-f598-4097-b429-2f6ba4e8566b req-89e6a4f0-2c27-4015-8495-df3b96acbe00 tempest-AttachVolumeTestJSON-1944334825 None] Deleting attachment 9b45caab-b4c9-49da-b131-2dd4f38f3746. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:40:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:40:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:40:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:40:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:40:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:40:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.055s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:40:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:40:58 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:40:58 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:40:59 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Nov 06 21:40:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.480s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:40:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:40:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:40:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 8 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:40:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:41:02 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=70,cinder:UPDATE=71,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:41:02 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:41:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-db14faaf-6135-4999-a21b-639fa3b3428f tempest-BackendsCapabilitiesAdminTestsJSON-1850785860 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7199096679688, 'free_capacity_gb': 1773.7199096679688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87069) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 21:41:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0649f9e7-28b5-40aa-9fa3-e3ebd088657f tempest-BackendsCapabilitiesAdminTestsJSON-1850785860 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7199096679688, 'free_capacity_gb': 1773.7199096679688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87069) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 21:41:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a10e6de0-bb27-42c4-a6df-91f79ad4caf3 tempest-GroupsV314Test-2003405087 None] Group tempest-GroupsV314Test-Group-530481620: creating Nov 06 21:41:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a10e6de0-bb27-42c4-a6df-91f79ad4caf3 tempest-GroupsV314Test-2003405087 None] Group tempest-GroupsV314Test-Group-530481620: created successfully Nov 06 21:41:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a10e6de0-bb27-42c4-a6df-91f79ad4caf3 tempest-GroupsV314Test-2003405087 None] Create group completed successfully. Nov 06 21:41:26 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:41:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Flow 'volume_create_manager' (1249cf08-a8f1-4cd0-83c7-0e3dd4f62c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af0e187-d33f-45a9-b0e6-20a9ba5b227e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af0e187-d33f-45a9-b0e6-20a9ba5b227e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508068264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a8cf086-1357-4574-ae88-157e0b2d4710,host='devstack@QuobyteHD#QuobyteHD',id=e48bea9c-d50f-4b93-bd50-254e4327b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e419731702f4d1d844d5e26aad1b2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:41:27Z,use_quota=True,user_id='d0a70f36d51044b5ad709081d305dfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adc69b0b-a47c-4765-b532-07c752ebbf8f),volume_type_id=adc69b0b-a47c-4765-b532-07c752ebbf8f)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ab8989-3e84-4fe0-abde-6a9a62c2cdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ab8989-3e84-4fe0-abde-6a9a62c2cdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0db3ebf-a3f3-4d74-b85b-a2e1b8fbc535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0db3ebf-a3f3-4d74-b85b-a2e1b8fbc535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48bea9c-d50f-4b93-bd50-254e4327b514', 'volume_name': 'volume-e48bea9c-d50f-4b93-bd50-254e4327b514', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40107b3a-87ab-4e94-b2c9-307ba7d11012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40107b3a-87ab-4e94-b2c9-307ba7d11012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce01cfb-b2ad-4b7a-a6ae-80df11a74a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:27 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Volume e48bea9c-d50f-4b93-bd50-254e4327b514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48bea9c-d50f-4b93-bd50-254e4327b514', 'volume_size': 1} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a8cf086-1357-4574-ae88-157e0b2d4710,created_at=2026-11-06T20:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508068264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a8cf086-1357-4574-ae88-157e0b2d4710,host='devstack@QuobyteHD#QuobyteHD',id=e48bea9c-d50f-4b93-bd50-254e4327b514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e419731702f4d1d844d5e26aad1b2a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:41:27Z,use_quota=True,user_id='d0a70f36d51044b5ad709081d305dfff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adc69b0b-a47c-4765-b532-07c752ebbf8f),volume_type_id=adc69b0b-a47c-4765-b532-07c752ebbf8f)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Creating volume e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:41:27 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:27 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 1073741824 Nov 06 21:41:27 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:27 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 1073741824" returned: 0 in 0.722s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:27 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 Nov 06 21:41:27 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:28 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514" returned: 0 in 0.284s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:41:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce01cfb-b2ad-4b7a-a6ae-80df11a74a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48bea9c-d50f-4b93-bd50-254e4327b514', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6028cbab-6215-470f-bd8b-e9c9df33ed4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:28 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Volume volume-e48bea9c-d50f-4b93-bd50-254e4327b514 (e48bea9c-d50f-4b93-bd50-254e4327b514): created successfully Nov 06 21:41:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6028cbab-6215-470f-bd8b-e9c9df33ed4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Flow 'volume_create_manager' (1249cf08-a8f1-4cd0-83c7-0e3dd4f62c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:41:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7e1e4195-5dd0-4956-9742-f9176d45082b tempest-GroupsV314Test-2003405087 None] Created volume successfully. Nov 06 21:41:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:30 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Cloning volume e48bea9c-d50f-4b93-bd50-254e4327b514 to volume 8bfdf829-1644-45a6-86f5-f0d2b500312a Nov 06 21:41:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Creating offline snapshot 400ccb47-ef88-4d04-a4db-8cde7e700846 of volume e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:41:30 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1362126b-67d7-458e-a061-37bacbdfea18]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:41:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:30 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 Nov 06 21:41:30 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:30 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514" returned: 0 in 0.463s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:30 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 1G Nov 06 21:41:30 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:31 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 1G" returned: 0 in 0.419s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e48bea9c-d50f-4b93-bd50-254e4327b514 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:31 devstack sudo[91480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e48bea9c-d50f-4b93-bd50-254e4327b514 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 Nov 06 21:41:31 devstack sudo[91480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:31 devstack sudo[91480]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e48bea9c-d50f-4b93-bd50-254e4327b514 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846" returned: 0 in 0.387s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:31 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:41:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:31 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 Nov 06 21:41:31 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:32 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846" returned: 0 in 0.461s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:32 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.info Nov 06 21:41:32 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:32 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.info" returned: 0 in 0.345s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:32 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:32 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.info Nov 06 21:41:32 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:32 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.info" returned: 0 in 0.396s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Acquiring lock "cinder-quobyte-8bfdf829-1644-45a6-86f5-f0d2b500312a" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Lock "cinder-quobyte-8bfdf829-1644-45a6-86f5-f0d2b500312a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] snapshot: 400ccb47-ef88-4d04-a4db-8cde7e700846, volume: 8bfdf829-1644-45a6-86f5-f0d2b500312a, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[db439182-41d4-4151-9d2e-7272e0ed4274]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:41:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:33 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 Nov 06 21:41:33 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:33 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846" returned: 0 in 0.485s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e48bea9c-d50f-4b93-bd50-254e4327b514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:41:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e423ecc-c6a3-4c7f-9131-4cd3a6b09d94]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:41:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:33 devstack sudo[91506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 Nov 06 21:41:33 devstack sudo[91506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:34 devstack sudo[91506]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514" returned: 0 in 0.531s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:41:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:41:34 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:41:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:34 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a Nov 06 21:41:34 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Flow 'volume_create_manager' (bb7b37e7-f647-4a6f-aadd-d5ea462dd6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594ded3d-65ec-48b3-82f7-9fced0ebd109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594ded3d-65ec-48b3-82f7-9fced0ebd109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-102621009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836fcd62-50eb-4578-8966-04cb26f3088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b93b7a2cf7401aabe1c2f379905b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:41:38Z,use_quota=True,user_id='94d50c7b335d4f60b02318a744404d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc35d7a0-ab47-4d55-838c-cf9569dc716a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc35d7a0-ab47-4d55-838c-cf9569dc716a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6aaec43-40f6-48b1-8e13-4766fd7aba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6aaec43-40f6-48b1-8e13-4766fd7aba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836fcd62-50eb-4578-8966-04cb26f3088b', 'volume_name': 'volume-836fcd62-50eb-4578-8966-04cb26f3088b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72eadf3-f1e6-4355-bf78-108e2e69b5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72eadf3-f1e6-4355-bf78-108e2e69b5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0720dc-363c-4734-a7c4-604d8cb5f766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:38 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Volume 836fcd62-50eb-4578-8966-04cb26f3088b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836fcd62-50eb-4578-8966-04cb26f3088b', 'volume_size': 1} Nov 06 21:41:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a" returned: 0 in 10.284s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514, size 1024.00 MB, duration 10.28 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:41:44 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Converted 1024.00 MB image at 99.57 MB/s Nov 06 21:41:44 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:44 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a Nov 06 21:41:44 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:44 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a" returned: 0 in 0.462s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Lock "cinder-quobyte-8bfdf829-1644-45a6-86f5-f0d2b500312a" released by "_copy_volume_from_snapshot" :: held 11.870s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Acquiring lock "cinder-quobyte-400ccb47-ef88-4d04-a4db-8cde7e700846" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Lock "cinder-quobyte-400ccb47-ef88-4d04-a4db-8cde7e700846" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Deleting offline snapshot 400ccb47-ef88-4d04-a4db-8cde7e700846 of volume e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] snapshot_file for this snap is: volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eda5e2d-42c1-4b57-a00d-8cef4a49db78]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:41:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:45 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 Nov 06 21:41:45 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:45 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846" returned: 0 in 0.774s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e48bea9c-d50f-4b93-bd50-254e4327b514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:41:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c4e416-81e2-4c61-9a88-2dcee98bf60c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:41:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:46 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 Nov 06 21:41:46 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:46 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514" returned: 0 in 0.983s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:46 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 Nov 06 21:41:46 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:47 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846" returned: 0 in 0.977s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:47 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846 Nov 06 21:41:47 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:48 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514.400ccb47-ef88-4d04-a4db-8cde7e700846" returned: 0 in 0.493s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Lock "cinder-quobyte-400ccb47-ef88-4d04-a4db-8cde7e700846" released by "_delete_snapshot" :: held 3.514s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.214s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.918s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-102621009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836fcd62-50eb-4578-8966-04cb26f3088b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b93b7a2cf7401aabe1c2f379905b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:41:38Z,use_quota=True,user_id='94d50c7b335d4f60b02318a744404d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Creating volume 836fcd62-50eb-4578-8966-04cb26f3088b {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:41:48 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:41:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:48 devstack sudo[91714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b 1073741824 Nov 06 21:41:48 devstack sudo[91714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-66fc70fe-1dce-4489-9859-3adae05a4c0a tempest-GroupsV314Test-2003405087 None] Create group from source-group-0a8cf086-1357-4574-ae88-157e0b2d4710 completed successfully. Nov 06 21:41:49 devstack sudo[91714]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b 1073741824" returned: 0 in 0.830s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:49 devstack sudo[91723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b Nov 06 21:41:49 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:50 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b" returned: 0 in 0.572s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c0720dc-363c-4734-a7c4-604d8cb5f766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836fcd62-50eb-4578-8966-04cb26f3088b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc87fde-e1a1-4e44-8987-fac9d39469f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Volume volume-836fcd62-50eb-4578-8966-04cb26f3088b (836fcd62-50eb-4578-8966-04cb26f3088b): created successfully Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc87fde-e1a1-4e44-8987-fac9d39469f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Flow 'volume_create_manager' (bb7b37e7-f647-4a6f-aadd-d5ea462dd6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:41:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fd671116-4b1d-46ff-bbe2-39011b68596a tempest-ServerActionsTestOtherA-1619012098 None] Created volume successfully. Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Flow 'volume_create_manager' (f34eadca-a0c0-4243-8448-df93fd268256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf453c42-22bc-4cb8-a952-d5e465f0f81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf453c42-22bc-4cb8-a952-d5e465f0f81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-536885466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70abab4f-d0de-4840-80b6-6ea6c706ed22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3912f8b2a74fd59df5fad08723d06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:41:50Z,use_quota=True,user_id='2f56ac18b00c469fba19434ab597b224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea913cb-7620-4c43-9091-e6081dd80204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea913cb-7620-4c43-9091-e6081dd80204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439c5c9c-6ab9-4d90-8d87-d4269eb0ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439c5c9c-6ab9-4d90-8d87-d4269eb0ff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70abab4f-d0de-4840-80b6-6ea6c706ed22', 'volume_name': 'volume-70abab4f-d0de-4840-80b6-6ea6c706ed22', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53dd484-7548-4db8-a117-ce4f17c76107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53dd484-7548-4db8-a117-ce4f17c76107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a425bb-bf44-457e-aae9-192ff7ea232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Volume 70abab4f-d0de-4840-80b6-6ea6c706ed22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70abab4f-d0de-4840-80b6-6ea6c706ed22', 'volume_size': 1} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-536885466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70abab4f-d0de-4840-80b6-6ea6c706ed22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3912f8b2a74fd59df5fad08723d06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:41:50Z,use_quota=True,user_id='2f56ac18b00c469fba19434ab597b224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Creating volume 70abab4f-d0de-4840-80b6-6ea6c706ed22 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:41:50 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:50 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 1073741824 Nov 06 21:41:50 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Acquiring lock "cinder-quobyte-8bfdf829-1644-45a6-86f5-f0d2b500312a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Lock "cinder-quobyte-8bfdf829-1644-45a6-86f5-f0d2b500312a" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb1195f-328a-4dc0-ae6a-dd948000c64f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:41:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:51 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 1073741824" returned: 0 in 0.708s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:51 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a Nov 06 21:41:51 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:51 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 Nov 06 21:41:51 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:51 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22" returned: 0 in 0.351s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9a425bb-bf44-457e-aae9-192ff7ea232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70abab4f-d0de-4840-80b6-6ea6c706ed22', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d26681c-9b73-49a2-b670-119df0d635b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:41:51 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Volume volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 (70abab4f-d0de-4840-80b6-6ea6c706ed22): created successfully Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d26681c-9b73-49a2-b670-119df0d635b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Flow 'volume_create_manager' (f34eadca-a0c0-4243-8448-df93fd268256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:41:51 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d3220416-f48d-4e5e-b5ff-a79a2518e5e5 tempest-AttachVolumeShelveTestJSON-1995763004 None] Created volume successfully. Nov 06 21:41:51 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a" returned: 0 in 0.820s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:51 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a Nov 06 21:41:51 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:51 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8bfdf829-1644-45a6-86f5-f0d2b500312a" returned: 0 in 0.271s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Lock "cinder-quobyte-8bfdf829-1644-45a6-86f5-f0d2b500312a" released by "delete_volume" :: held 1.168s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:41:51 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Created reservations ['08ae1c00-e1f3-4403-86cd-65db4d75adf7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:41:52 devstack cinder-volume[87069]: WARNING cinder.quota [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2100562856 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2100562856, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:41:52 devstack cinder-volume[87069]: WARNING cinder.quota [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2100562856 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2100562856, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:41:52 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Created reservations ['2c0df8a6-7d10-470f-aed5-bda7164874a9', 'caa89690-6ce8-4d25-a3bf-f18f2a68eba2', '70478953-2189-45f2-96d2-4f67a73ec4aa', '5e2bc7b7-e4ad-4b8b-aaf5-30d5aa71a864'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:41:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:41:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:41:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:52 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:41:52 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:53 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.665s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:53 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:41:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cff8b401-9b3d-4b58-aed7-1e7f8d735aab tempest-GroupsV314Test-2003405087 None] Delete group completed successfully. Nov 06 21:41:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Acquiring lock "cinder-quobyte-e48bea9c-d50f-4b93-bd50-254e4327b514" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:41:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Lock "cinder-quobyte-e48bea9c-d50f-4b93-bd50-254e4327b514" acquired by "delete_volume" :: waited 0.035s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:41:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea20e75-7d54-442e-8864-f25481c70fec]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:41:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:54 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 Nov 06 21:41:54 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:54 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514" returned: 0 in 0.586s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:54 devstack sudo[91804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514 Nov 06 21:41:54 devstack sudo[91804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:55 devstack sudo[91804]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e48bea9c-d50f-4b93-bd50-254e4327b514" returned: 0 in 0.410s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Lock "cinder-quobyte-e48bea9c-d50f-4b93-bd50-254e4327b514" released by "delete_volume" :: held 1.147s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Created reservations ['e1b0b751-c106-49dd-b947-1389a883be21'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Created reservations ['1d82664f-7582-4136-b4e9-352a3b240834', '2a1e3132-0351-4bb2-8da5-7081e2e0c297', '891d90e3-9ed0-4e5c-8aac-1ea511227c94', '6ed00729-9d20-4b42-9517-d2f67b646107'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:55 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:41:55 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:56 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.544s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:56 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:41:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-bc48b19a-740b-4989-9400-a1c209b361e4 tempest-GroupsV314Test-2003405087 None] Delete group completed successfully. Nov 06 21:41:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:41:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:41:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:41:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:41:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:41:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:41:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:41:58 devstack sudo[91825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:41:58 devstack sudo[91825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:41:59 devstack sudo[91825]: pam_unix(sudo:session): session closed for user root Nov 06 21:41:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.788s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:41:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:41:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:41:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 8 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:41:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:42:05 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=22,cinder:SELECT=21,cinder:INSERT=7 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:42:05 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=32,cinder:UPDATE=43,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:42:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-040f0f14-d4d2-4296-bd60-9b2c4a2353b1 req-91ad03ba-90a0-4417-8476-c69ea5c9d2d9 tempest-AttachVolumeShelveTestJSON-1995763004 None] No connector for attachment 3217f7da-a130-4ae9-8bb3-4c1e8a80bea7; skipping storage backend terminate_connection call. {{(pid=87069) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 06 21:42:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-040f0f14-d4d2-4296-bd60-9b2c4a2353b1 req-91ad03ba-90a0-4417-8476-c69ea5c9d2d9 tempest-AttachVolumeShelveTestJSON-1995763004 None] Deleting attachment 3217f7da-a130-4ae9-8bb3-4c1e8a80bea7. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Flow 'volume_create_manager' (407bf3d1-7fd9-4afd-ad13-37811ca9351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745c8009-9382-4982-bc79-57460ccb6619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745c8009-9382-4982-bc79-57460ccb6619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1312251798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180753da-14d4-43a2-887e-46df00cbdc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82605d3c9084bb9aeeaaa7dfadfbf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:12Z,use_quota=True,user_id='7790be6244d9442c8dc8f1bb35cd9046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1c1d77-640e-43e8-8112-6224fa0a0595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff1c1d77-640e-43e8-8112-6224fa0a0595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c4a056-8f71-43d9-aec1-487f531b3d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c4a056-8f71-43d9-aec1-487f531b3d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '180753da-14d4-43a2-887e-46df00cbdc92', 'volume_name': 'volume-180753da-14d4-43a2-887e-46df00cbdc92', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e088b4-69ff-4859-866b-d8aa82ff1105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e088b4-69ff-4859-866b-d8aa82ff1105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b53b49-4bd9-4cbb-bd07-b551e1291a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:11 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Volume 180753da-14d4-43a2-887e-46df00cbdc92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-180753da-14d4-43a2-887e-46df00cbdc92', 'volume_size': 1} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1312251798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180753da-14d4-43a2-887e-46df00cbdc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82605d3c9084bb9aeeaaa7dfadfbf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:12Z,use_quota=True,user_id='7790be6244d9442c8dc8f1bb35cd9046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Creating volume 180753da-14d4-43a2-887e-46df00cbdc92 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:42:11 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:42:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:11 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 1073741824 Nov 06 21:42:11 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:12 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 1073741824" returned: 0 in 0.624s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:12 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 Nov 06 21:42:12 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:12 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b53b49-4bd9-4cbb-bd07-b551e1291a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180753da-14d4-43a2-887e-46df00cbdc92', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ff5492-ae18-44ef-b8d2-096e6e1c5328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:12 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Volume volume-180753da-14d4-43a2-887e-46df00cbdc92 (180753da-14d4-43a2-887e-46df00cbdc92): created successfully Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ff5492-ae18-44ef-b8d2-096e6e1c5328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Flow 'volume_create_manager' (407bf3d1-7fd9-4afd-ad13-37811ca9351c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:12 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-700c2a47-c5c9-4f8a-9cde-d2b52dc7b5bf tempest-AttachVolumeTestJSON-1944334825 None] Created volume successfully. Nov 06 21:42:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-08fed6a9-d6cb-4fa2-bf88-29ba1af4876d req-190ab12a-90a8-4806-bec0-ab84e8b7494d tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-08fed6a9-d6cb-4fa2-bf88-29ba1af4876d req-190ab12a-90a8-4806-bec0-ab84e8b7494d tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-08fed6a9-d6cb-4fa2-bf88-29ba1af4876d req-190ab12a-90a8-4806-bec0-ab84e8b7494d tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-08fed6a9-d6cb-4fa2-bf88-29ba1af4876d req-190ab12a-90a8-4806-bec0-ab84e8b7494d tempest-AttachVolumeTestJSON-1944334825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-180753da-14d4-43a2-887e-46df00cbdc92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ede5d2f-032b-4562-93c3-8027769e9766', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:42:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-08fed6a9-d6cb-4fa2-bf88-29ba1af4876d req-190ab12a-90a8-4806-bec0-ab84e8b7494d tempest-AttachVolumeTestJSON-1944334825 None] attachment_update completed successfully. Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Flow 'volume_create_manager' (0543e159-596e-4be8-9358-db2054b3710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1ecd0f-70c3-4f40-8976-415cb7e7fc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1ecd0f-70c3-4f40-8976-415cb7e7fc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-513181323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728c471d-3834-4dab-97ac-d40756c128e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82605d3c9084bb9aeeaaa7dfadfbf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:18Z,use_quota=True,user_id='7790be6244d9442c8dc8f1bb35cd9046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b991c0-a10d-4472-be8b-5cc5bc295800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b991c0-a10d-4472-be8b-5cc5bc295800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02072cd9-407c-434a-9b92-21f056965089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02072cd9-407c-434a-9b92-21f056965089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728c471d-3834-4dab-97ac-d40756c128e3', 'volume_name': 'volume-728c471d-3834-4dab-97ac-d40756c128e3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771ec563-a27b-45f3-9102-77ed958bac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (771ec563-a27b-45f3-9102-77ed958bac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08623993-a27d-4e01-8abb-fad28add7227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:18 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Volume 728c471d-3834-4dab-97ac-d40756c128e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728c471d-3834-4dab-97ac-d40756c128e3', 'volume_size': 1} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-513181323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728c471d-3834-4dab-97ac-d40756c128e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e82605d3c9084bb9aeeaaa7dfadfbf55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:18Z,use_quota=True,user_id='7790be6244d9442c8dc8f1bb35cd9046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Creating volume 728c471d-3834-4dab-97ac-d40756c128e3 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:42:18 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:42:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:18 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 1073741824 Nov 06 21:42:18 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:19 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 1073741824" returned: 0 in 0.782s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:19 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 Nov 06 21:42:19 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:19 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3" returned: 0 in 0.425s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:42:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08623993-a27d-4e01-8abb-fad28add7227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728c471d-3834-4dab-97ac-d40756c128e3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbaf65c-3fc7-40fe-8da0-640fae008f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Volume volume-728c471d-3834-4dab-97ac-d40756c128e3 (728c471d-3834-4dab-97ac-d40756c128e3): created successfully Nov 06 21:42:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bbaf65c-3fc7-40fe-8da0-640fae008f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Flow 'volume_create_manager' (0543e159-596e-4be8-9358-db2054b3710f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f6a4e074-63b3-4ffd-bbfe-d5c777dcdef0 tempest-AttachVolumeTestJSON-1944334825 None] Created volume successfully. Nov 06 21:42:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f1f8cde1-56d1-4d21-9104-af1e7540dc73 req-0a624093-6a40-47ab-a24d-f37a975ec924 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f1f8cde1-56d1-4d21-9104-af1e7540dc73 req-0a624093-6a40-47ab-a24d-f37a975ec924 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f1f8cde1-56d1-4d21-9104-af1e7540dc73 req-0a624093-6a40-47ab-a24d-f37a975ec924 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f1f8cde1-56d1-4d21-9104-af1e7540dc73 req-0a624093-6a40-47ab-a24d-f37a975ec924 tempest-ServerActionsTestOtherA-1619012098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-836fcd62-50eb-4578-8966-04cb26f3088b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '258ef4d4-1423-42c2-893c-67cd3cfc0789', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:42:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-f1f8cde1-56d1-4d21-9104-af1e7540dc73 req-0a624093-6a40-47ab-a24d-f37a975ec924 tempest-ServerActionsTestOtherA-1619012098 None] attachment_update completed successfully. Nov 06 21:42:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-0844fd02-47d8-4116-a9f4-10b5f7bb8e83 req-d72d6fb2-17a9-4d86-af51-969fdcb607eb tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-0844fd02-47d8-4116-a9f4-10b5f7bb8e83 req-d72d6fb2-17a9-4d86-af51-969fdcb607eb tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-0844fd02-47d8-4116-a9f4-10b5f7bb8e83 req-d72d6fb2-17a9-4d86-af51-969fdcb607eb tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-0844fd02-47d8-4116-a9f4-10b5f7bb8e83 req-d72d6fb2-17a9-4d86-af51-969fdcb607eb tempest-AttachVolumeTestJSON-1944334825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-728c471d-3834-4dab-97ac-d40756c128e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a31a4f9-967a-41ef-9a21-3fee87795faa', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:42:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-0844fd02-47d8-4116-a9f4-10b5f7bb8e83 req-d72d6fb2-17a9-4d86-af51-969fdcb607eb tempest-AttachVolumeTestJSON-1944334825 None] attachment_update completed successfully. Nov 06 21:42:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-af0a9c43-0357-4a95-947e-0afc67d9fa85 req-855e92fc-0aa5-4751-a8f4-28ac2c94650e tempest-AttachVolumeTestJSON-1944334825 None] Terminate volume connection completed successfully. Nov 06 21:42:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-af0a9c43-0357-4a95-947e-0afc67d9fa85 req-855e92fc-0aa5-4751-a8f4-28ac2c94650e tempest-AttachVolumeTestJSON-1944334825 None] Deleting attachment 3ede5d2f-032b-4562-93c3-8027769e9766. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:42:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-a335a9c5-7b9b-4c5b-bd61-0a6eaccfbdd5 req-02f71644-af4a-4884-a753-bf0420629dd6 tempest-ServerActionsTestOtherA-1619012098 None] Terminate volume connection completed successfully. Nov 06 21:42:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-a335a9c5-7b9b-4c5b-bd61-0a6eaccfbdd5 req-02f71644-af4a-4884-a753-bf0420629dd6 tempest-ServerActionsTestOtherA-1619012098 None] Deleting attachment 258ef4d4-1423-42c2-893c-67cd3cfc0789. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:42:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-a335a9c5-7b9b-4c5b-bd61-0a6eaccfbdd5 req-4a7df9ed-ac97-4dfc-8a56-6fb5cf531f87 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-a335a9c5-7b9b-4c5b-bd61-0a6eaccfbdd5 req-4a7df9ed-ac97-4dfc-8a56-6fb5cf531f87 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-a335a9c5-7b9b-4c5b-bd61-0a6eaccfbdd5 req-4a7df9ed-ac97-4dfc-8a56-6fb5cf531f87 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-a335a9c5-7b9b-4c5b-bd61-0a6eaccfbdd5 req-4a7df9ed-ac97-4dfc-8a56-6fb5cf531f87 tempest-ServerActionsTestOtherA-1619012098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-836fcd62-50eb-4578-8966-04cb26f3088b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddd37323-f3ab-4cdd-9ad3-c13e301f2c78', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:42:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-a335a9c5-7b9b-4c5b-bd61-0a6eaccfbdd5 req-4a7df9ed-ac97-4dfc-8a56-6fb5cf531f87 tempest-ServerActionsTestOtherA-1619012098 None] attachment_update completed successfully. Nov 06 21:42:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-cf8e862e-baea-477e-8e67-05baef9d3a61 req-cae6daf0-2ba4-42b4-ac4e-dbd83fd56802 tempest-AttachVolumeTestJSON-1944334825 None] Terminate volume connection completed successfully. Nov 06 21:42:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-cf8e862e-baea-477e-8e67-05baef9d3a61 req-cae6daf0-2ba4-42b4-ac4e-dbd83fd56802 tempest-AttachVolumeTestJSON-1944334825 None] Deleting attachment 0a31a4f9-967a-41ef-9a21-3fee87795faa. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:42:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "cinder-728c471d-3834-4dab-97ac-d40756c128e3-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-728c471d-3834-4dab-97ac-d40756c128e3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "cinder-quobyte-728c471d-3834-4dab-97ac-d40756c128e3" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-quobyte-728c471d-3834-4dab-97ac-d40756c128e3" acquired by "delete_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:35 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c5190d-725f-4745-b989-6f770d05c336]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:35 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 Nov 06 21:42:35 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:36 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3" returned: 0 in 0.403s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:36 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3 Nov 06 21:42:36 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:36 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-728c471d-3834-4dab-97ac-d40756c128e3" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-quobyte-728c471d-3834-4dab-97ac-d40756c128e3" released by "delete_volume" :: held 0.720s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Created reservations ['d8401f5a-79b4-43ad-8e11-9d03126559f2', 'c9aa2253-cb8c-4602-ae35-c6ddf8ee3a6b', '3932c615-ef4e-4ded-88e1-0b4b65212007', 'f72a1ee2-9c6e-4ac2-a322-6b518a80841d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:36 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:42:36 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "cinder-180753da-14d4-43a2-887e-46df00cbdc92-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-180753da-14d4-43a2-887e-46df00cbdc92-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:36 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.324s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:42:36 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Deleted volume successfully. Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "cinder-quobyte-180753da-14d4-43a2-887e-46df00cbdc92" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a6c6d94d-1891-4048-a81c-dbfa21ee3224 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-728c471d-3834-4dab-97ac-d40756c128e3-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-quobyte-180753da-14d4-43a2-887e-46df00cbdc92" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76c771-218e-4023-a110-aa601ce46fc3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:37 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 Nov 06 21:42:37 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:37 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92" returned: 0 in 0.416s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:37 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92 Nov 06 21:42:37 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:37 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-180753da-14d4-43a2-887e-46df00cbdc92" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-quobyte-180753da-14d4-43a2-887e-46df00cbdc92" released by "delete_volume" :: held 0.755s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Created reservations ['6f7e518f-0a18-498b-b9d3-dbd40e1ca495', '4f879387-e088-468a-9466-4073231e84a6', '1f430f94-c0ec-49b9-8993-38b69bc595d0', '9694ba15-77a4-4bb2-9b5e-a1fb29d2c665'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:37 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:42:37 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "cinder-3e48603d-1f44-40e6-87b5-62b0ef440261-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:38 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.403s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-3e48603d-1f44-40e6-87b5-62b0ef440261-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Deleted volume successfully. Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-97bf1193-112f-4c1a-aca7-166945f1a466 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-180753da-14d4-43a2-887e-46df00cbdc92-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "cinder-quobyte-3e48603d-1f44-40e6-87b5-62b0ef440261" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-quobyte-3e48603d-1f44-40e6-87b5-62b0ef440261" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fb7afd-9da2-4d35-9b06-7ab06ee67991]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:38 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 Nov 06 21:42:38 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:38 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261" returned: 0 in 0.403s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:38 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261 Nov 06 21:42:38 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:39 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3e48603d-1f44-40e6-87b5-62b0ef440261" returned: 0 in 0.288s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-quobyte-3e48603d-1f44-40e6-87b5-62b0ef440261" released by "delete_volume" :: held 0.744s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Created reservations ['1ad1d6f6-406e-491b-ac94-5f3c81a9ef78', '72863e5d-357a-40d5-974b-153479c16c8d', '6fb1969a-112f-4988-8661-a404a71b8b92', 'd884980d-f9a8-41b8-9b81-aa12ac535d30'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:39 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:42:39 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:39 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.396s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:42:39 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Deleted volume successfully. Nov 06 21:42:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26132e6c-bd0f-4a0c-9088-d14f373d5506 tempest-AttachVolumeTestJSON-1944334825 None] Lock "cinder-3e48603d-1f44-40e6-87b5-62b0ef440261-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Flow 'volume_create_manager' (8a8a6927-9ada-47c4-b5df-6c35c239dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b206aeb7-a350-437e-8e70-a259aa5bda3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b206aeb7-a350-437e-8e70-a259aa5bda3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-875509497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64534ea5-2e91-43aa-9dae-72b5a985d7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8d9a6417d04d2ab27c33aa54d90b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:43Z,use_quota=True,user_id='59d2914edef04f55bdfaa39c3857350d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b04ce65-d1bd-4fd2-b25b-c87cc4a91f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b04ce65-d1bd-4fd2-b25b-c87cc4a91f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698a9e9f-6be5-4d1d-96d8-376f1ce9e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698a9e9f-6be5-4d1d-96d8-376f1ce9e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64534ea5-2e91-43aa-9dae-72b5a985d7c3', 'volume_name': 'volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21626267-1a2f-48fe-acc5-e6ac43306d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21626267-1a2f-48fe-acc5-e6ac43306d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be22105f-9f24-40e5-b220-61f7558bbc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:43 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Volume 64534ea5-2e91-43aa-9dae-72b5a985d7c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3', 'volume_size': 1} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-875509497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64534ea5-2e91-43aa-9dae-72b5a985d7c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb8d9a6417d04d2ab27c33aa54d90b37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:43Z,use_quota=True,user_id='59d2914edef04f55bdfaa39c3857350d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Creating volume 64534ea5-2e91-43aa-9dae-72b5a985d7c3 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:42:43 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:43 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 1073741824 Nov 06 21:42:43 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:43 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 1073741824" returned: 0 in 0.481s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:43 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 Nov 06 21:42:43 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:44 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3" returned: 0 in 0.369s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:42:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be22105f-9f24-40e5-b220-61f7558bbc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9daa90-d227-4fd6-9a3c-1b86184a5c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:44 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Volume volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 (64534ea5-2e91-43aa-9dae-72b5a985d7c3): created successfully Nov 06 21:42:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9daa90-d227-4fd6-9a3c-1b86184a5c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Flow 'volume_create_manager' (8a8a6927-9ada-47c4-b5df-6c35c239dd86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:44 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-63392a59-7007-4d7d-a75a-9426da705586 tempest-AbsoluteLimitsTests-1172489219 None] Created volume successfully. Nov 06 21:42:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Acquiring lock "cinder-64534ea5-2e91-43aa-9dae-72b5a985d7c3-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Lock "cinder-64534ea5-2e91-43aa-9dae-72b5a985d7c3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Acquiring lock "cinder-quobyte-64534ea5-2e91-43aa-9dae-72b5a985d7c3" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Lock "cinder-quobyte-64534ea5-2e91-43aa-9dae-72b5a985d7c3" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cce9f4-831f-4b62-beab-2ac81f3ff915]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:45 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 Nov 06 21:42:45 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:46 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3" returned: 0 in 0.452s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:46 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3 Nov 06 21:42:46 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:46 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64534ea5-2e91-43aa-9dae-72b5a985d7c3" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Lock "cinder-quobyte-64534ea5-2e91-43aa-9dae-72b5a985d7c3" released by "delete_volume" :: held 0.773s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Created reservations ['07d1de9b-5eb8-49cc-9487-4fc53c25bc37', 'cbebee91-29e3-453a-8c87-30e95d3d2bba', '1d848838-faa8-4963-8af7-a5a1d739bd44', '765813dc-71ae-46fe-958b-3aa46539998a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:46 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:42:46 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:46 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.255s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:42:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Deleted volume successfully. Nov 06 21:42:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8aaafca9-f25f-4f6b-ab6e-611fa2bf31a6 tempest-AbsoluteLimitsTests-1172489219 None] Lock "cinder-64534ea5-2e91-43aa-9dae-72b5a985d7c3-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Flow 'volume_create_manager' (9c86f9ef-b8a4-48fe-957a-d0d6e7c08001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61acde54-6b89-4305-8718-d35c17892d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61acde54-6b89-4305-8718-d35c17892d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1951742385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf31c5a-6414-449d-8896-06b884ffb122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c61c8a88d04216a46a36e2db751884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:49Z,use_quota=True,user_id='655ab05a064e4183a2def5dd29a1b06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2a8021-3596-4296-bc0e-fd71adaa92a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba2a8021-3596-4296-bc0e-fd71adaa92a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71750c02-c1e9-4ddf-aeeb-af05b74dbb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71750c02-c1e9-4ddf-aeeb-af05b74dbb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdf31c5a-6414-449d-8896-06b884ffb122', 'volume_name': 'volume-cdf31c5a-6414-449d-8896-06b884ffb122', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c92e6f-61cf-4aef-a3ba-fee7d67a8959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c92e6f-61cf-4aef-a3ba-fee7d67a8959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d407d0a-6a83-4f53-81df-9c1173b70966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:48 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Volume cdf31c5a-6414-449d-8896-06b884ffb122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdf31c5a-6414-449d-8896-06b884ffb122', 'volume_size': 1} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1951742385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdf31c5a-6414-449d-8896-06b884ffb122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c61c8a88d04216a46a36e2db751884',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:49Z,use_quota=True,user_id='655ab05a064e4183a2def5dd29a1b06b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Creating volume cdf31c5a-6414-449d-8896-06b884ffb122 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:42:48 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:42:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:48 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 1073741824 Nov 06 21:42:48 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:49 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 1073741824" returned: 0 in 0.447s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:49 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 Nov 06 21:42:49 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:49 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122" returned: 0 in 0.270s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d407d0a-6a83-4f53-81df-9c1173b70966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdf31c5a-6414-449d-8896-06b884ffb122', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a4e1f6-d947-43c6-9afe-7ecbc37e73d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:49 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Volume volume-cdf31c5a-6414-449d-8896-06b884ffb122 (cdf31c5a-6414-449d-8896-06b884ffb122): created successfully Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a4e1f6-d947-43c6-9afe-7ecbc37e73d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Flow 'volume_create_manager' (9c86f9ef-b8a4-48fe-957a-d0d6e7c08001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-f41d448a-09d2-4f88-9114-3af6894aafcb req-4b1aa3df-e481-4f27-bea8-330238f44272 tempest-VolumesSnapshotsTestJSON-717402 None] Created volume successfully. Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Creating offline snapshot 75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 of volume cdf31c5a-6414-449d-8896-06b884ffb122 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0594fe53-15b9-4ffd-9cf9-dd3836639de5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:50 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 Nov 06 21:42:50 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:50 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122" returned: 0 in 0.400s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:50 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 1G Nov 06 21:42:50 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:50 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 1G" returned: 0 in 0.444s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf31c5a-6414-449d-8896-06b884ffb122 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:50 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf31c5a-6414-449d-8896-06b884ffb122 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 Nov 06 21:42:50 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:51 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdf31c5a-6414-449d-8896-06b884ffb122 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8" returned: 0 in 0.308s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:51 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 is being set with open permissions: ugo+rw Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:51 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 Nov 06 21:42:51 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:51 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:51 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.info Nov 06 21:42:51 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:42:51 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Flow 'volume_create_manager' (9511e376-1927-42e4-980f-7574e81b2f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3bdfc4-224a-458c-978a-ffcc6ea875d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.info" returned: 0 in 0.297s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:51 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.info is being set with open permissions: ugo+rw Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3bdfc4-224a-458c-978a-ffcc6ea875d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-617983327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c916882-6590-45aa-a75c-4cc0d152a906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0b144d5a064891b3018bca61bd241b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:52Z,use_quota=True,user_id='05b3b269527140469c9112cbc958744c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:51 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.info Nov 06 21:42:51 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0ee720-06d4-4937-8f97-a5add6ac9f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e0ee720-06d4-4937-8f97-a5add6ac9f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2565f4fc-9cbc-45be-9629-070aa01e9b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2565f4fc-9cbc-45be-9629-070aa01e9b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c916882-6590-45aa-a75c-4cc0d152a906', 'volume_name': 'volume-1c916882-6590-45aa-a75c-4cc0d152a906', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49cf69c1-2fea-413c-9c8d-8e73ac400253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49cf69c1-2fea-413c-9c8d-8e73ac400253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ea3dc9-a516-4687-823d-5ac44354417f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:51 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Volume 1c916882-6590-45aa-a75c-4cc0d152a906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c916882-6590-45aa-a75c-4cc0d152a906', 'volume_size': 1} Nov 06 21:42:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:52 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.info" returned: 0 in 0.254s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.213s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-617983327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c916882-6590-45aa-a75c-4cc0d152a906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0b144d5a064891b3018bca61bd241b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:42:52Z,use_quota=True,user_id='05b3b269527140469c9112cbc958744c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Creating volume 1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:42:52 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:52 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 1073741824 Nov 06 21:42:52 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-1a35aa6c-474f-4dd3-af3c-69ad98fd06bf req-e27184dd-b63e-4470-ba3b-8bd4c2199350 tempest-VolumesSnapshotsTestJSON-717402 None] Create snapshot completed successfully Nov 06 21:42:52 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 1073741824" returned: 0 in 0.410s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:52 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 Nov 06 21:42:52 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:52 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906" returned: 0 in 0.244s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ea3dc9-a516-4687-823d-5ac44354417f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c916882-6590-45aa-a75c-4cc0d152a906', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37465bf-5d86-48ae-ad0d-e8c6b8bf3ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:42:52 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Volume volume-1c916882-6590-45aa-a75c-4cc0d152a906 (1c916882-6590-45aa-a75c-4cc0d152a906): created successfully Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37465bf-5d86-48ae-ad0d-e8c6b8bf3ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Flow 'volume_create_manager' (9511e376-1927-42e4-980f-7574e81b2f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:42:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-bad0a99e-4838-4d35-b4ec-6958e68409b2 tempest-VolumesDeleteCascade-2014258515 None] Created volume successfully. Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "cinder-75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "cinder-quobyte-cdf31c5a-6414-449d-8896-06b884ffb122" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-quobyte-cdf31c5a-6414-449d-8896-06b884ffb122" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "cinder-quobyte-75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-quobyte-75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Deleting offline snapshot 75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 of volume cdf31c5a-6414-449d-8896-06b884ffb122 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] snapshot_file for this snap is: volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b27d07-8cd8-451b-8fb5-9861b84c3093]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:53 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 Nov 06 21:42:53 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:53 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8" returned: 0 in 0.392s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdf31c5a-6414-449d-8896-06b884ffb122(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af7234-b44a-48ab-9c3f-4b4978f64304]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:53 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 Nov 06 21:42:53 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:53 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122" returned: 0 in 0.422s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:53 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 Nov 06 21:42:53 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Creating offline snapshot d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 of volume 1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0075a3-2272-4f7f-8322-ed8c70ec57d9]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:54 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:54 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8" returned: 0 in 0.427s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:54 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:54 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8 Nov 06 21:42:54 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:54 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:54 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906" returned: 0 in 0.402s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122.75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8" returned: 0 in 0.283s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:54 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 1G Nov 06 21:42:54 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-quobyte-75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8" released by "_delete_snapshot" :: held 1.680s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-quobyte-cdf31c5a-6414-449d-8896-06b884ffb122" released by "delete_snapshot" :: held 1.711s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:54 devstack cinder-volume[87069]: WARNING cinder.quota [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG cinder.quota [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Created reservations ['0836d312-0c27-43a2-acbd-a41dc9e581e1', 'ef388698-e89f-422a-9171-4bc094383bd2', 'aeac66d9-a51d-49f2-b0e1-8efd67969ff6', '1893e061-ebc3-4efe-8385-2dd6333971f4'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:42:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Delete snapshot completed successfully. Nov 06 21:42:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-b5829a6c-9244-49e7-8bf7-b919d36080c4 req-558c6e73-6992-4606-bb14-271fdea5b8ef tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-75c1c64d-2ec2-4172-a4d3-e7f3ebd1f6e8-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:55 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 1G" returned: 0 in 0.474s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c916882-6590-45aa-a75c-4cc0d152a906 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:55 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c916882-6590-45aa-a75c-4cc0d152a906 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 Nov 06 21:42:55 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "cinder-cdf31c5a-6414-449d-8896-06b884ffb122-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-cdf31c5a-6414-449d-8896-06b884ffb122-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "cinder-quobyte-cdf31c5a-6414-449d-8896-06b884ffb122" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-quobyte-cdf31c5a-6414-449d-8896-06b884ffb122" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[447a9995-90d6-47e3-9ddb-02e53f559933]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:55 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c916882-6590-45aa-a75c-4cc0d152a906 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" returned: 0 in 0.334s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:55 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 is being set with open permissions: ugo+rw Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:55 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 Nov 06 21:42:55 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:55 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 Nov 06 21:42:55 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:55 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" returned: 0 in 0.264s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:55 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.info Nov 06 21:42:55 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:55 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122" returned: 0 in 0.409s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:55 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122 Nov 06 21:42:55 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:55 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.info" returned: 0 in 0.315s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:56 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.info is being set with open permissions: ugo+rw Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:56 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.info Nov 06 21:42:56 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:56 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cdf31c5a-6414-449d-8896-06b884ffb122" returned: 0 in 0.305s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-quobyte-cdf31c5a-6414-449d-8896-06b884ffb122" released by "delete_volume" :: held 0.783s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG cinder.quota [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Created reservations ['c18176e9-864f-42f2-b5ee-6f220f73b9c7', '4ee3bbc1-f4f2-4264-a25a-7dd959afb665', '051e90a7-7394-4555-9e2a-ca1e097d9295', '0ee3329e-d1e3-429d-b8a7-368832f6db7d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:56 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:42:56 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:56 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.info" returned: 0 in 0.420s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d3d9d582-7f82-45d5-abe2-7e959311474f tempest-VolumesDeleteCascade-2014258515 None] Create snapshot completed successfully Nov 06 21:42:56 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.524s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG cinder.manager [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:42:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Deleted volume successfully. Nov 06 21:42:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-ad32ad78-209f-42cc-83e1-e1a84d10a440 req-44742ac9-8d22-4f62-a8cb-89360ab91cfa tempest-VolumesSnapshotsTestJSON-717402 None] Lock "cinder-cdf31c5a-6414-449d-8896-06b884ffb122-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:42:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Creating offline snapshot 4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad of volume 1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:42:57 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2611f5-7dad-4c6b-b3c6-e4f44cbbcbbe]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:42:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:57 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 Nov 06 21:42:57 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:58 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-cb0bc3dc-bef5-4283-a6c4-8b68e5afadf7 req-5dc46552-69d1-4d51-93b8-1f7490cf287f tempest-ServerActionsTestOtherA-1619012098 None] Terminate volume connection completed successfully. Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-cb0bc3dc-bef5-4283-a6c4-8b68e5afadf7 req-5dc46552-69d1-4d51-93b8-1f7490cf287f tempest-ServerActionsTestOtherA-1619012098 None] Deleting attachment ddd37323-f3ab-4cdd-9ad3-c13e301f2c78. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:42:58 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" returned: 0 in 0.616s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c916882-6590-45aa-a75c-4cc0d152a906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:58 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad 1G Nov 06 21:42:58 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:42:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:58 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:42:58 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:59 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad 1G" returned: 0 in 0.742s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:59 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad Nov 06 21:42:59 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:59 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.468s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 8 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:42:59 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad" returned: 0 in 0.496s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:42:59 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad is being set with open permissions: ugo+rw Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:42:59 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad Nov 06 21:42:59 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:42:59 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Nov 06 21:42:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad" returned: 0 in 0.321s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:00 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fb017436-95c9-4645-b89c-d2141f76d5de tempest-VolumesDeleteCascade-2014258515 None] Create snapshot completed successfully Nov 06 21:43:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-1c916882-6590-45aa-a75c-4cc0d152a906-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-1c916882-6590-45aa-a75c-4cc0d152a906-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Performing cascade delete. {{(pid=87069) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Acquiring lock "cinder-70abab4f-d0de-4840-80b6-6ea6c706ed22-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "cinder-70abab4f-d0de-4840-80b6-6ea6c706ed22-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Acquiring lock "cinder-quobyte-70abab4f-d0de-4840-80b6-6ea6c706ed22" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "cinder-quobyte-70abab4f-d0de-4840-80b6-6ea6c706ed22" acquired by "delete_volume" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Deleting offline snapshot 4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad of volume 1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] snapshot_file for this snap is: volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[43985783-2363-4454-a3ec-9a7f2c6ed75d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[59714b56-ff7f-49ee-88f7-9e0a03916433]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:01 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 Nov 06 21:43:01 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:01 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad Nov 06 21:43:01 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:01 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22" returned: 0 in 0.498s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:01 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22 Nov 06 21:43:01 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:01 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad" returned: 0 in 0.545s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c916882-6590-45aa-a75c-4cc0d152a906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e2836e-9b95-424c-a7c4-83b46642047d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:02 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 Nov 06 21:43:02 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:02 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-70abab4f-d0de-4840-80b6-6ea6c706ed22" returned: 0 in 0.372s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "cinder-quobyte-70abab4f-d0de-4840-80b6-6ea6c706ed22" released by "delete_volume" :: held 0.974s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Flow 'volume_create_manager' (0b2c072d-b502-42b0-9274-373591c3f1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5207e5da-aecd-4748-a4cd-9b98888adc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5207e5da-aecd-4748-a4cd-9b98888adc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1075539219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05763d1a-0bc7-475d-8ec3-2cdefd57622a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68bbcd8edd9340b2a22482e51c4944ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:02Z,use_quota=True,user_id='69d0b594b1634eb1952543586fe5352c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9264b5d-8454-4f47-9128-2a8be19fb335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9264b5d-8454-4f47-9128-2a8be19fb335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e1a804-4c0b-41c1-9e88-3f264f771aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e1a804-4c0b-41c1-9e88-3f264f771aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05763d1a-0bc7-475d-8ec3-2cdefd57622a', 'volume_name': 'volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad618b46-bd2e-4ccd-bceb-aee800f91ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad618b46-bd2e-4ccd-bceb-aee800f91ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f977acd7-b344-48c0-82ba-4404a6d8c29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Volume 05763d1a-0bc7-475d-8ec3-2cdefd57622a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a', 'volume_size': 1} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1075539219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05763d1a-0bc7-475d-8ec3-2cdefd57622a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='68bbcd8edd9340b2a22482e51c4944ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:02Z,use_quota=True,user_id='69d0b594b1634eb1952543586fe5352c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Creating volume 05763d1a-0bc7-475d-8ec3-2cdefd57622a {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:02 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:02 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" returned: 0 in 0.485s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c916882-6590-45aa-a75c-4cc0d152a906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:02 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a 1073741824 Nov 06 21:43:02 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Created reservations ['09b53db3-c63e-4f73-9b8e-10f5ab06561f', 'c5c62c53-3c64-468c-a04b-ec2a56b26f2b', '74e66bb6-67f5-4efd-a27f-a1bf1fefed2f', '355b9a01-08f0-426e-b930-ac6c62748a2b'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:02 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad Nov 06 21:43:02 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:02 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:43:02 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:02 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.282s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:43:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Deleted volume successfully. Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c4f0f340-288d-4bf2-a554-d6d6340b5092 tempest-AttachVolumeShelveTestJSON-1995763004 None] Lock "cinder-70abab4f-d0de-4840-80b6-6ea6c706ed22-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:02 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad" returned: 0 in 0.476s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:02 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a 1073741824" returned: 0 in 0.521s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:02 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad Nov 06 21:43:02 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:03 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a Nov 06 21:43:03 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:03 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad" released by "_delete_snapshot" :: held 1.939s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:03 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" released by "delete_snapshot" :: held 1.994s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f977acd7-b344-48c0-82ba-4404a6d8c29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e142f40-ebd3-4d8f-99e9-f0aec360f4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:03 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Volume volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a (05763d1a-0bc7-475d-8ec3-2cdefd57622a): created successfully Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e142f40-ebd3-4d8f-99e9-f0aec360f4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Flow 'volume_create_manager' (0b2c072d-b502-42b0-9274-373591c3f1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-98e359dc-574c-4b07-9304-7397079c7c5c req-4fd1ea1e-5ff7-42b6-b0b1-b149424d0c26 tempest-VolumesGetTestJSON-1900991895 None] Created volume successfully. Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Created reservations ['51223092-7e56-4d76-97b1-baa63bc5d1cb', '960f38db-6c4a-4597-bea6-365768b2d9ec', '4db75870-c490-4d51-82e4-d3ea34147e7b', '2e06c309-c4b8-471c-8b8f-e2a762f7f33f'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Delete snapshot completed successfully. Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-4e69e8b0-3e4d-42d3-8f24-dfd4c9bd64ad-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Deleting offline snapshot d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 of volume 1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] snapshot_file for this snap is: volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f989a3f-fb86-48fc-9440-b927bd44750f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:03 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 Nov 06 21:43:03 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:03 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" returned: 0 in 0.387s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c916882-6590-45aa-a75c-4cc0d152a906(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2194a29d-a0a3-4d6c-aa76-e8cb7dcb257c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:04 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 Nov 06 21:43:04 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:04 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906" returned: 0 in 0.458s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:04 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 Nov 06 21:43:04 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Acquiring lock "cinder-05763d1a-0bc7-475d-8ec3-2cdefd57622a-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Lock "cinder-05763d1a-0bc7-475d-8ec3-2cdefd57622a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Acquiring lock "cinder-quobyte-05763d1a-0bc7-475d-8ec3-2cdefd57622a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Lock "cinder-quobyte-05763d1a-0bc7-475d-8ec3-2cdefd57622a" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b2d212-a57c-46a9-bae8-c8700a8e00ae]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:04 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" returned: 0 in 0.474s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:04 devstack sudo[93541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384 Nov 06 21:43:04 devstack sudo[93541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:04 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a Nov 06 21:43:04 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:05 devstack sudo[93541]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906.d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" returned: 0 in 0.376s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:05 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a" returned: 0 in 0.523s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384" released by "_delete_snapshot" :: held 1.874s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" released by "delete_snapshot" :: held 1.902s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:05 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a Nov 06 21:43:05 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Flow 'volume_create_manager' (fbd7c4cc-96a7-4a84-aa25-a3bb939ebe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0590eeb4-18a6-4782-aee1-ee5706c44eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0590eeb4-18a6-4782-aee1-ee5706c44eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-436530168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e7f746-d38f-473f-9300-81461324bb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b93b7a2cf7401aabe1c2f379905b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:05Z,use_quota=True,user_id='94d50c7b335d4f60b02318a744404d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6114219-b452-4d3d-97e6-6d4f5a946f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6114219-b452-4d3d-97e6-6d4f5a946f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc017c37-68c4-43e5-a017-ce29d44f55a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Created reservations ['d4858ae1-fba9-489c-88f0-b0dd59bb6768', '26115182-2f6b-4658-85cf-bcb8b0f91613', 'fd607556-991a-4c17-958e-ad0bd274f678', '728d1f2f-d77f-4c38-a5f8-dcedc192775a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:05 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Delete snapshot completed successfully. Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-d1c3f4ff-2b23-4bcd-9a02-7b666f5bc384-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Snapshots deleted, issuing volume delete {{(pid=87069) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:05 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-05763d1a-0bc7-475d-8ec3-2cdefd57622a" returned: 0 in 0.331s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Lock "cinder-quobyte-05763d1a-0bc7-475d-8ec3-2cdefd57622a" released by "delete_volume" :: held 0.906s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=105,cinder:INSERT=21,cinder:UPDATE=89,cinder:DELETE=8 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b669817-a118-44a3-b74e-ddb30c4b78c4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=100,cinder:UPDATE=99,cinder:DELETE=7,cinder:INSERT=23 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.quota [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Created reservations ['38eb6c53-c1e5-4de3-8e03-780d6137820a', '00df6e1c-575c-4e79-b992-70ab61b50435', '1b0aafe0-2e12-4915-b095-31f37881c695', '0090354f-2d04-4c7f-a65f-3fa065b07645'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:05 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 Nov 06 21:43:05 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:05 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:43:05 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc017c37-68c4-43e5-a017-ce29d44f55a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30e7f746-d38f-473f-9300-81461324bb6e', 'volume_name': 'volume-30e7f746-d38f-473f-9300-81461324bb6e', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661169c6-ad7f-4260-8266-2249e2c51a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661169c6-ad7f-4260-8266-2249e2c51a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c851051-05b5-4fee-be1c-09f27e8ead18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:06 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Volume 30e7f746-d38f-473f-9300-81461324bb6e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30e7f746-d38f-473f-9300-81461324bb6e', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Trying to clone 30e7f746-d38f-473f-9300-81461324bb6e from image 190b0bd5-9057-4553-8deb-2ec752071230 at location (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:43:06 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906" returned: 0 in 0.465s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:06 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906 Nov 06 21:43:06 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:06 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.352s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.manager [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:43:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Deleted volume successfully. Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-a51ae21e-14bc-437e-88f4-35857b7a6994 req-4095d881-c09c-4997-a983-12d7b3832674 tempest-VolumesGetTestJSON-1900991895 None] Lock "cinder-05763d1a-0bc7-475d-8ec3-2cdefd57622a-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:43:06 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d4ef06-e81f-41d6-9b6f-115d2e162848]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:06 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1c916882-6590-45aa-a75c-4cc0d152a906" returned: 0 in 0.425s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-1c916882-6590-45aa-a75c-4cc0d152a906" released by "delete_volume" :: held 0.982s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Created reservations ['3c8bbe4a-d14b-4edd-95a9-0de5e7dc2805', 'dfcd7827-0876-47f5-89e1-6904d4b969e2', '1dd82759-d591-496f-b0ef-15dde6ecb741', '24eb053b-cf8a-436b-9534-294d9996a1a0'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:06 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD Nov 06 21:43:06 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:06 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:43:06 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:06 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:06 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 is fetched for user 94d50c7b335d4f60b02318a744404d6e. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:43:07 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.260s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:43:07 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Deleted volume successfully. Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4a627a31-06f4-4cad-bafc-fa15bb4e677e tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-1c916882-6590-45aa-a75c-4cc0d152a906-delete_volume" released by "delete_volume" :: held 6.062s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbd9cb7-fd0e-42b2-b2ec-ffafb15ba4fa]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:07 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD Nov 06 21:43:07 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:07 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-436530168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e7f746-d38f-473f-9300-81461324bb6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90b93b7a2cf7401aabe1c2f379905b32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:05Z,use_quota=True,user_id='94d50c7b335d4f60b02318a744404d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Creating volume 30e7f746-d38f-473f-9300-81461324bb6e {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:07 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:07 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e 1073741824 Nov 06 21:43:07 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:08 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e 1073741824" returned: 0 in 0.582s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:08 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e Nov 06 21:43:08 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:08 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e" returned: 0 in 0.395s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Attempting download of 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume 30e7f746-d38f-473f-9300-81461324bb6e. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6a4fe0-16a0-4c08-906c-6e00ee1a77b0]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_91f1kbdk {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Flow 'volume_create_manager' (21e4cf66-b794-482e-bf5e-51583f887768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a932f5-394d-4031-9459-f43b770c56e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a932f5-394d-4031-9459-f43b770c56e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1861070231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322d4658-bbed-43b9-b564-5e8cac089202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0b144d5a064891b3018bca61bd241b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:09Z,use_quota=True,user_id='05b3b269527140469c9112cbc958744c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ba7153-f66f-45c8-b982-53bba2b41c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ba7153-f66f-45c8-b982-53bba2b41c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99eb0e6-0ceb-4f6b-818b-adb9138ce21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99eb0e6-0ceb-4f6b-818b-adb9138ce21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '322d4658-bbed-43b9-b564-5e8cac089202', 'volume_name': 'volume-322d4658-bbed-43b9-b564-5e8cac089202', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee9de81-a10d-4543-b7e5-cfedb00d9005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee9de81-a10d-4543-b7e5-cfedb00d9005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38489d72-b22a-4a94-b8fa-1b0898a5be31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:08 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Volume 322d4658-bbed-43b9-b564-5e8cac089202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-322d4658-bbed-43b9-b564-5e8cac089202', 'volume_size': 1} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1861070231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=322d4658-bbed-43b9-b564-5e8cac089202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0b144d5a064891b3018bca61bd241b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:09Z,use_quota=True,user_id='05b3b269527140469c9112cbc958744c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Creating volume 322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:08 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_91f1kbdk Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:08 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:08 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:08 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 1073741824 Nov 06 21:43:08 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:09 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_91f1kbdk" returned: 0 in 0.441s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_91f1kbdk {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:09 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_91f1kbdk Nov 06 21:43:09 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:09 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 1073741824" returned: 0 in 0.578s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:09 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 Nov 06 21:43:09 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:09 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_91f1kbdk" returned: 1 in 0.436s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_91f1kbdk' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2327885e-ba08-4e5e-9625-48bceceec9fa]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:09 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD Nov 06 21:43:09 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:09 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202" returned: 0 in 0.331s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38489d72-b22a-4a94-b8fa-1b0898a5be31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-322d4658-bbed-43b9-b564-5e8cac089202', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8246a1d-4c02-4217-8acb-303ee06ba010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:09 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Volume volume-322d4658-bbed-43b9-b564-5e8cac089202 (322d4658-bbed-43b9-b564-5e8cac089202): created successfully Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8246a1d-4c02-4217-8acb-303ee06ba010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Flow 'volume_create_manager' (21e4cf66-b794-482e-bf5e-51583f887768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:09 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6262b56b-3697-4aa9-b5cb-5b8ca2cd5810 tempest-VolumesDeleteCascade-2014258515 None] Created volume successfully. Nov 06 21:43:10 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:10 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] 190b0bd5-9057-4553-8deb-2ec752071230 was qcow2, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:43:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:10 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e Nov 06 21:43:10 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Creating offline snapshot d9756dbd-6bca-4b78-9782-f75a4c6eb32e of volume 322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:43:11 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00f5242-e5ec-4298-91b5-64d18176f722]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:11 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 Nov 06 21:43:11 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:11 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202" returned: 0 in 0.523s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:11 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e 1G Nov 06 21:43:11 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:12 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e 1G" returned: 0 in 0.582s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-322d4658-bbed-43b9-b564-5e8cac089202 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:12 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-322d4658-bbed-43b9-b564-5e8cac089202 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e Nov 06 21:43:12 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:12 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e" returned: 0 in 2.384s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_2yli5ls1devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:43:12 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Converted 112.00 MB image at 46.96 MB/s Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:12 devstack sudo[93652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e 1G Nov 06 21:43:12 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:12 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-322d4658-bbed-43b9-b564-5e8cac089202 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e" returned: 0 in 0.384s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:12 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e is being set with open permissions: ugo+rw Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:12 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e Nov 06 21:43:12 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:12 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e 1G" returned: 0 in 0.419s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Downloaded image 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume 30e7f746-d38f-473f-9300-81461324bb6e successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 for user 94d50c7b335d4f60b02318a744404d6e is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Marking volume 30e7f746-d38f-473f-9300-81461324bb6e as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Copying metadata from image 190b0bd5-9057-4553-8deb-2ec752071230 to 30e7f746-d38f-473f-9300-81461324bb6e. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Creating volume glance metadata for volume 30e7f746-d38f-473f-9300-81461324bb6e backed by image 190b0bd5-9057-4553-8deb-2ec752071230 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:43:12 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e" returned: 0 in 0.280s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c851051-05b5-4fee-be1c-09f27e8ead18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e7f746-d38f-473f-9300-81461324bb6e', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e79109-2cb2-489b-b884-50068998e8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:13 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Volume volume-30e7f746-d38f-473f-9300-81461324bb6e (30e7f746-d38f-473f-9300-81461324bb6e): created successfully Nov 06 21:43:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e79109-2cb2-489b-b884-50068998e8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:13 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.info Nov 06 21:43:13 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Flow 'volume_create_manager' (fbd7c4cc-96a7-4a84-aa25-a3bb939ebe27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f561e116-025d-42b9-b21d-29a1204bc23a tempest-GroupSnapshotsTest-19394807 None] Group tempest-GroupSnapshotsTest-Group-1442211879: creating Nov 06 21:43:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-05063bc6-f691-4a3b-b1bc-ef00f0386d13 tempest-ServerActionsTestOtherA-1619012098 None] Created volume successfully. Nov 06 21:43:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f561e116-025d-42b9-b21d-29a1204bc23a tempest-GroupSnapshotsTest-19394807 None] Group tempest-GroupSnapshotsTest-Group-1442211879: created successfully Nov 06 21:43:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f561e116-025d-42b9-b21d-29a1204bc23a tempest-GroupSnapshotsTest-19394807 None] Create group completed successfully. Nov 06 21:43:13 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.info" returned: 0 in 0.291s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:13 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.info is being set with open permissions: ugo+rw Nov 06 21:43:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:13 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.info Nov 06 21:43:13 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:13 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.info" returned: 0 in 0.253s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-21422c5a-0581-4715-a287-2037b9f71f45 tempest-VolumesDeleteCascade-2014258515 None] Create snapshot completed successfully Nov 06 21:43:14 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Flow 'volume_create_manager' (1fdefa80-f324-4e69-8f66-a7975e7bedf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c99b0f6-f40c-4cd9-b4d8-6b64778c6d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c99b0f6-f40c-4cd9-b4d8-6b64778c6d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269988378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69b2d46f-8345-4473-9010-011f2097f35d,host='devstack@QuobyteHD#QuobyteHD',id=b1c35965-80ab-4c7e-a475-ec0045505bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a34249275e64be7a55282ed4072d673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:15Z,use_quota=True,user_id='91b9f646926a4445a3ba6d22cc724724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20058ee4-3c45-4a41-a778-0c2834800061),volume_type_id=20058ee4-3c45-4a41-a778-0c2834800061)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a15c08-934b-4db6-987b-1fdff6113f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a15c08-934b-4db6-987b-1fdff6113f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd2850a-1b6d-419a-ab94-9425cd4093d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd2850a-1b6d-419a-ab94-9425cd4093d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1c35965-80ab-4c7e-a475-ec0045505bf1', 'volume_name': 'volume-b1c35965-80ab-4c7e-a475-ec0045505bf1', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffe0a12-af36-4a9a-ab3f-eb68101f4395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffe0a12-af36-4a9a-ab3f-eb68101f4395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5478322c-5e11-4e41-88c6-a6c511c0968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Volume b1c35965-80ab-4c7e-a475-ec0045505bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1c35965-80ab-4c7e-a475-ec0045505bf1', 'volume_size': 1} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=69b2d46f-8345-4473-9010-011f2097f35d,created_at=2026-11-06T20:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269988378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69b2d46f-8345-4473-9010-011f2097f35d,host='devstack@QuobyteHD#QuobyteHD',id=b1c35965-80ab-4c7e-a475-ec0045505bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a34249275e64be7a55282ed4072d673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:15Z,use_quota=True,user_id='91b9f646926a4445a3ba6d22cc724724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20058ee4-3c45-4a41-a778-0c2834800061),volume_type_id=20058ee4-3c45-4a41-a778-0c2834800061)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Creating volume b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:15 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:15 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 1073741824 Nov 06 21:43:15 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Flow 'volume_create_manager' (12e8ac9e-4132-4e41-a1e5-85ed9f221677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3aab52-ef27-4b08-8da3-33a454c03f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3aab52-ef27-4b08-8da3-33a454c03f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1092390461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f55563-6b37-448e-ae4f-9206f1d89737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0b144d5a064891b3018bca61bd241b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9756dbd-6bca-4b78-9782-f75a4c6eb32e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:15Z,use_quota=True,user_id='05b3b269527140469c9112cbc958744c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77882cb8-bb25-4652-be42-bdaa97e1c284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77882cb8-bb25-4652-be42-bdaa97e1c284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89de17cb-639a-4591-beb4-3bd40630fc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89de17cb-639a-4591-beb4-3bd40630fc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7f55563-6b37-448e-ae4f-9206f1d89737', 'volume_name': 'volume-a7f55563-6b37-448e-ae4f-9206f1d89737', 'volume_size': 1, 'snapshot_id': 'd9756dbd-6bca-4b78-9782-f75a4c6eb32e'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a5e7c4-17d1-4929-93c5-116d5d239d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a5e7c4-17d1-4929-93c5-116d5d239d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03cc730-5384-41c1-b759-9a9a0d1e435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:15 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Volume a7f55563-6b37-448e-ae4f-9206f1d89737: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7f55563-6b37-448e-ae4f-9206f1d89737', 'volume_size': 1, 'snapshot_id': 'd9756dbd-6bca-4b78-9782-f75a4c6eb32e'} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:15 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 1073741824" returned: 0 in 0.735s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:15 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 Nov 06 21:43:15 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:16 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1" returned: 0 in 0.427s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.769s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-d9756dbd-6bca-4b78-9782-f75a4c6eb32e-a7f55563-6b37-448e-ae4f-9206f1d89737" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5478322c-5e11-4e41-88c6-a6c511c0968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1c35965-80ab-4c7e-a475-ec0045505bf1', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1893cb2b-4760-4786-8b40-80872168b44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-d9756dbd-6bca-4b78-9782-f75a4c6eb32e-a7f55563-6b37-448e-ae4f-9206f1d89737" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Creating volume a7f55563-6b37-448e-ae4f-9206f1d89737 from snapshot d9756dbd-6bca-4b78-9782-f75a4c6eb32e {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-a7f55563-6b37-448e-ae4f-9206f1d89737" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:16 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Volume volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 (b1c35965-80ab-4c7e-a475-ec0045505bf1): created successfully Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1893cb2b-4760-4786-8b40-80872168b44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Flow 'volume_create_manager' (1fdefa80-f324-4e69-8f66-a7975e7bedf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ef4833ff-f094-4672-88b8-214ccb03629c tempest-GroupSnapshotsTest-19394807 None] Created volume successfully. Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-a7f55563-6b37-448e-ae4f-9206f1d89737" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] snapshot: d9756dbd-6bca-4b78-9782-f75a4c6eb32e, volume: a7f55563-6b37-448e-ae4f-9206f1d89737, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e373f-6054-4cb8-ac21-fb564690624d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:16 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e Nov 06 21:43:16 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:16 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e" returned: 0 in 0.460s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-322d4658-bbed-43b9-b564-5e8cac089202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee45195-c4b9-4d6c-b72e-ef3bf1afc7a8]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:17 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 Nov 06 21:43:17 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:17 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202" returned: 0 in 0.472s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:43:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:43:17 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:43:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:17 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 Nov 06 21:43:17 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:17 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] GroupSnapshot 5e3ac297-44a4-484c-8c25-72821ab435d1: creating. Nov 06 21:43:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Group snapshot 5e3ac297-44a4-484c-8c25-72821ab435d1: creating. {{(pid=87069) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 21:43:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-957a8dff-b945-4b8a-9767-abf77e8e2ecd req-7515a542-1d66-4257-aaff-fdd4b4348b15 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Flow 'volume_create_manager' (dfd0dcc9-46c4-4ba2-adeb-3fb4d0c348c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38a9a1b-2203-4d99-a7a9-6e8aaf302923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38a9a1b-2203-4d99-a7a9-6e8aaf302923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2077089807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5b9095b76243cea8471669f5a8f250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:22Z,use_quota=True,user_id='f1afc49c0e0742fdb0b520d31ed08318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678538b4-f47e-491e-b451-786c3893c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678538b4-f47e-491e-b451-786c3893c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d55029-b165-4baf-95ae-a13d14090587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d55029-b165-4baf-95ae-a13d14090587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b', 'volume_name': 'volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e61a9f9-c8ee-40f7-b6a3-1397c26c83cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e61a9f9-c8ee-40f7-b6a3-1397c26c83cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b2d668-6436-4c6e-aea8-f9f538734be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:22 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b', 'volume_size': 1} Nov 06 21:43:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:25 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737" returned: 0 in 8.260s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:25 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:43:25 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Converted 1024.00 MB image at 123.96 MB/s Nov 06 21:43:25 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 is being set with open permissions: ugo+rw Nov 06 21:43:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:25 devstack sudo[93728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 Nov 06 21:43:25 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:25 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-a7f55563-6b37-448e-ae4f-9206f1d89737" released by "_copy_volume_from_snapshot" :: held 9.550s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-d9756dbd-6bca-4b78-9782-f75a4c6eb32e-a7f55563-6b37-448e-ae4f-9206f1d89737" released by "_create_volume_from_snapshot" :: held 9.641s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.679s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.234s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Creating offline snapshot b330d464-3279-46af-b396-b23010db5cd1 of volume b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03cc730-5384-41c1-b759-9a9a0d1e435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f55563-6b37-448e-ae4f-9206f1d89737', 'volume_size': 1, 'snapshot_id': 'd9756dbd-6bca-4b78-9782-f75a4c6eb32e'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83311e37-9fe0-462a-a083-c0d2b45b0364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baa1e1c-87e3-42ea-9dfa-019ad6912226]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:26 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Volume volume-a7f55563-6b37-448e-ae4f-9206f1d89737 (a7f55563-6b37-448e-ae4f-9206f1d89737): created successfully Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83311e37-9fe0-462a-a083-c0d2b45b0364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Flow 'volume_create_manager' (12e8ac9e-4132-4e41-a1e5-85ed9f221677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-15f50e53-3331-45b5-9b82-78c0b56234e6 tempest-VolumesDeleteCascade-2014258515 None] Created volume successfully. Nov 06 21:43:26 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 Nov 06 21:43:26 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:26 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1" returned: 0 in 0.362s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:26 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 1G Nov 06 21:43:26 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-322d4658-bbed-43b9-b564-5e8cac089202-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-322d4658-bbed-43b9-b564-5e8cac089202-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Performing cascade delete. {{(pid=87069) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-d9756dbd-6bca-4b78-9782-f75a4c6eb32e-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-d9756dbd-6bca-4b78-9782-f75a4c6eb32e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-322d4658-bbed-43b9-b564-5e8cac089202" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-322d4658-bbed-43b9-b564-5e8cac089202" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-d9756dbd-6bca-4b78-9782-f75a4c6eb32e" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-d9756dbd-6bca-4b78-9782-f75a4c6eb32e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Deleting offline snapshot d9756dbd-6bca-4b78-9782-f75a4c6eb32e of volume 322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] snapshot_file for this snap is: volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[888b3132-2af1-49cc-bcf2-c7706ce683cf]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:26 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 1G" returned: 0 in 0.490s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:26 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 Nov 06 21:43:26 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:27 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e Nov 06 21:43:27 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:27 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1" returned: 0 in 0.292s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:27 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:27 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 Nov 06 21:43:27 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:27 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-322d4658-bbed-43b9-b564-5e8cac089202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e680609-3f24-4b5b-a22a-07e4cbf3e462]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:27 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 Nov 06 21:43:27 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:27 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1" returned: 0 in 0.248s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:27 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.info Nov 06 21:43:27 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:27 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.info" returned: 0 in 0.251s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:27 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:27 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.info Nov 06 21:43:27 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:27 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202" returned: 0 in 0.559s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:27 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e Nov 06 21:43:27 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:28 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.info" returned: 0 in 0.275s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-957a8dff-b945-4b8a-9767-abf77e8e2ecd req-7515a542-1d66-4257-aaff-fdd4b4348b15 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.263s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-957a8dff-b945-4b8a-9767-abf77e8e2ecd req-7515a542-1d66-4257-aaff-fdd4b4348b15 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.458s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2077089807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f5b9095b76243cea8471669f5a8f250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:22Z,use_quota=True,user_id='f1afc49c0e0742fdb0b520d31ed08318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Creating volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:28 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:28 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b 1073741824 Nov 06 21:43:28 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-957a8dff-b945-4b8a-9767-abf77e8e2ecd req-7515a542-1d66-4257-aaff-fdd4b4348b15 tempest-ServerActionsTestOtherA-1619012098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-30e7f746-d38f-473f-9300-81461324bb6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be4a0180-55fb-473c-9724-ff40d4e383b6', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:43:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c84f3663-3741-4a52-9de7-21ba5d4e5acf tempest-GroupSnapshotsTest-19394807 None] group_snapshot 5e3ac297-44a4-484c-8c25-72821ab435d1: created successfully Nov 06 21:43:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-957a8dff-b945-4b8a-9767-abf77e8e2ecd req-7515a542-1d66-4257-aaff-fdd4b4348b15 tempest-ServerActionsTestOtherA-1619012098 None] attachment_update completed successfully. Nov 06 21:43:28 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e" returned: 0 in 0.397s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:28 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e Nov 06 21:43:28 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:28 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202.d9756dbd-6bca-4b78-9782-f75a4c6eb32e" returned: 0 in 0.296s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-d9756dbd-6bca-4b78-9782-f75a4c6eb32e" released by "_delete_snapshot" :: held 1.727s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-322d4658-bbed-43b9-b564-5e8cac089202" released by "delete_snapshot" :: held 1.757s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:28 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b 1073741824" returned: 0 in 0.536s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Created reservations ['88019fbe-e5ea-4214-b84a-c0e9dba061ab', '1ca9b74e-61fc-4c94-98b4-bd106256c94d', 'ef018edd-6421-447c-b04f-f75c45c05313', 'ac55f05a-3596-42aa-928a-de298d8ea1c9'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:28 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b Nov 06 21:43:28 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Delete snapshot completed successfully. Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-d9756dbd-6bca-4b78-9782-f75a4c6eb32e-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Snapshots deleted, issuing volume delete {{(pid=87069) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-322d4658-bbed-43b9-b564-5e8cac089202" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-322d4658-bbed-43b9-b564-5e8cac089202" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fe39ae-eaca-4f23-a3fe-b2526d9bd1b0]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:29 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" returned: 0 in 0.392s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b2d668-6436-4c6e-aea8-f9f538734be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3254b304-7770-4cde-b589-5cf701cc6e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:29 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Volume volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b (dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b): created successfully Nov 06 21:43:29 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 Nov 06 21:43:29 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3254b304-7770-4cde-b589-5cf701cc6e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Flow 'volume_create_manager' (dfd0dcc9-46c4-4ba2-adeb-3fb4d0c348c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:29 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-72bb3e9e-de69-40b4-b89e-3aa03e176147 tempest-SnapshotsActionsTest-113287957 None] Created volume successfully. Nov 06 21:43:29 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202" returned: 0 in 0.847s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:29 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202 Nov 06 21:43:29 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-b330d464-3279-46af-b396-b23010db5cd1-461fcba6-04ad-47e7-846e-e838025700f2" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-b330d464-3279-46af-b396-b23010db5cd1-461fcba6-04ad-47e7-846e-e838025700f2" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Creating volume 461fcba6-04ad-47e7-846e-e838025700f2 from snapshot b330d464-3279-46af-b396-b23010db5cd1 {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-461fcba6-04ad-47e7-846e-e838025700f2" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-461fcba6-04ad-47e7-846e-e838025700f2" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] snapshot: b330d464-3279-46af-b396-b23010db5cd1, volume: 461fcba6-04ad-47e7-846e-e838025700f2, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53997d4-511c-4400-8439-116fb5186b68]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:30 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-322d4658-bbed-43b9-b564-5e8cac089202" returned: 0 in 0.625s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-322d4658-bbed-43b9-b564-5e8cac089202" released by "delete_volume" :: held 1.634s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:30 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 Nov 06 21:43:30 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Created reservations ['04b93948-6fee-40a2-92d4-b7563786ef30', 'f9db82cd-6126-4045-b2fb-fcc58bbff927', '5d2a3e64-e674-4283-b646-13d876ef8fb2', '0e608235-ddc9-4eac-90a6-d6fb96d93483'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:30 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:43:30 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:30 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1" returned: 0 in 0.470s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1c35965-80ab-4c7e-a475-ec0045505bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f282f85-b9c9-4957-bde1-e6932449b1fe]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:30 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.293s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:30 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:43:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Deleted volume successfully. Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-03d66be8-45f2-4704-a6df-350f0ba57a22 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-322d4658-bbed-43b9-b564-5e8cac089202-delete_volume" released by "delete_volume" :: held 4.265s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:31 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 Nov 06 21:43:31 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:31 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1" returned: 0 in 0.652s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:31 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 Nov 06 21:43:31 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-a7f55563-6b37-448e-ae4f-9206f1d89737-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-a7f55563-6b37-448e-ae4f-9206f1d89737-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "cinder-quobyte-a7f55563-6b37-448e-ae4f-9206f1d89737" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-a7f55563-6b37-448e-ae4f-9206f1d89737" acquired by "delete_volume" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8489a1d2-6d80-491c-8f38-46ad91cd9a16]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:32 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 Nov 06 21:43:32 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:32 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737" returned: 0 in 0.734s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:32 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737 Nov 06 21:43:32 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:33 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a7f55563-6b37-448e-ae4f-9206f1d89737" returned: 0 in 0.916s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-quobyte-a7f55563-6b37-448e-ae4f-9206f1d89737" released by "delete_volume" :: held 1.727s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Created reservations ['55377fbc-3379-4171-b107-458398aae756', '2db6e11e-3a57-4138-af9c-eba145c59b25', '686080e1-9171-4e0e-b9e9-1797ef7b8f2e', 'c236369d-107c-4980-99db-1c5ca5f63ecc'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:33 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:43:33 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:34 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.535s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:34 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:43:34 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Deleted volume successfully. Nov 06 21:43:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f608d564-8082-4b35-9797-82a2123af6b4 tempest-VolumesDeleteCascade-2014258515 None] Lock "cinder-a7f55563-6b37-448e-ae4f-9206f1d89737-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:43 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2" returned: 0 in 11.524s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1, size 1024.00 MB, duration 11.52 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:43:43 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Converted 1024.00 MB image at 88.85 MB/s Nov 06 21:43:43 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:43 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 Nov 06 21:43:43 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:43 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2" returned: 0 in 0.309s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-461fcba6-04ad-47e7-846e-e838025700f2" released by "_copy_volume_from_snapshot" :: held 13.138s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-b330d464-3279-46af-b396-b23010db5cd1-461fcba6-04ad-47e7-846e-e838025700f2" released by "_create_volume_from_snapshot" :: held 13.246s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.286s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.950s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Creating offline snapshot 50082a10-e004-469d-b380-ce3ba712437f of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f87a543-dadb-436d-bc7f-028569af223d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a3e8510b-1748-4d1a-af9f-62543fc21768 tempest-GroupSnapshotsTest-19394807 None] Create group from source-snapshot-5e3ac297-44a4-484c-8c25-72821ab435d1 completed successfully. Nov 06 21:43:43 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b Nov 06 21:43:43 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:44 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" returned: 0 in 0.493s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:44 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f 1G Nov 06 21:43:44 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:44 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f 1G" returned: 0 in 0.640s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:44 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:43:44 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:45 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.425s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:45 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f is being set with open permissions: ugo+rw Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:45 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:43:45 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-461fcba6-04ad-47e7-846e-e838025700f2" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-461fcba6-04ad-47e7-846e-e838025700f2" acquired by "delete_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0f60be-00b7-466c-8852-ba0e4c35f383]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:45 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 Nov 06 21:43:45 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:45 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.577s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:45 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.info Nov 06 21:43:45 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:45 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2" returned: 0 in 0.516s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:45 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2 Nov 06 21:43:45 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:46 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.info" returned: 0 in 0.355s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:46 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.info is being set with open permissions: ugo+rw Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:46 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.info Nov 06 21:43:46 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:46 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-461fcba6-04ad-47e7-846e-e838025700f2" returned: 0 in 0.501s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-461fcba6-04ad-47e7-846e-e838025700f2" released by "delete_volume" :: held 1.158s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Created reservations ['91695b52-a66e-455a-b3cd-906b993def16'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:46 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.info" returned: 0 in 0.479s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.215s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:46 devstack cinder-volume[87069]: WARNING cinder.quota [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1428148548 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1428148548, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:43:46 devstack cinder-volume[87069]: WARNING cinder.quota [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1428148548 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1428148548, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:43:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-7324c627-cd4f-4127-bc01-500c0be7e711 req-d9551e93-6dc8-4041-ae9b-de4faaf1569d tempest-ServerActionsTestOtherA-1619012098 None] Terminate volume connection completed successfully. Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-7324c627-cd4f-4127-bc01-500c0be7e711 req-d9551e93-6dc8-4041-ae9b-de4faaf1569d tempest-ServerActionsTestOtherA-1619012098 None] Deleting attachment be4a0180-55fb-473c-9724-ff40d4e383b6. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Created reservations ['0666b802-822d-4534-8255-9ead07abf469', 'c70955a9-bf38-4676-852c-fa408ad236a3', 'c3ba4c4f-7b00-4e1e-bfba-bb316e1dd04c', '848d38c2-5431-4577-ba5c-207c11719fde'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-40021599-1cad-4e54-bd3f-06a64cce7497 tempest-SnapshotsActionsTest-113287957 None] Create snapshot completed successfully Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:46 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:43:46 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:47 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.345s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:47 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:43:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-35a6f38c-83d2-47ab-81ef-dbfdff2d569c tempest-GroupSnapshotsTest-19394807 None] Delete group completed successfully. Nov 06 21:43:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] group_snapshot 5e3ac297-44a4-484c-8c25-72821ab435d1: deleting Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] group_snapshot 5e3ac297-44a4-484c-8c25-72821ab435d1: deleting {{(pid=87069) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-b1c35965-80ab-4c7e-a475-ec0045505bf1" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-b1c35965-80ab-4c7e-a475-ec0045505bf1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-b330d464-3279-46af-b396-b23010db5cd1" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-b330d464-3279-46af-b396-b23010db5cd1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Deleting offline snapshot b330d464-3279-46af-b396-b23010db5cd1 of volume b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] snapshot_file for this snap is: volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055e270-ac9c-4e83-8dba-579652a77ca5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:48 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 Nov 06 21:43:48 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Creating offline snapshot 0f7d2769-2970-44d1-9bfe-3ab5e58fab8b of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9748cf-f523-4626-8010-a5a507657ae9]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-7324c627-cd4f-4127-bc01-500c0be7e711 req-fbd0f392-7881-4a9c-b20e-aa37ad4256c1 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:48 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:43:48 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:48 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1" returned: 0 in 0.545s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1c35965-80ab-4c7e-a475-ec0045505bf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d750e3-4a9c-420a-836a-e90f4b074817]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:49 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 Nov 06 21:43:49 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:49 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.489s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:49 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b 1G Nov 06 21:43:49 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:49 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1" returned: 0 in 0.552s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:49 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 Nov 06 21:43:49 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:49 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b 1G" returned: 0 in 0.504s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:49 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b Nov 06 21:43:49 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:49 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:49 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1 Nov 06 21:43:49 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:50 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b" returned: 0 in 0.423s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:50 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b is being set with open permissions: ugo+rw Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:50 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b Nov 06 21:43:50 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Flow 'volume_create_manager' (75a6d1b1-6bcc-4120-b671-cbe9adcababe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b035bb6c-f444-4457-a791-d99d42e5ed77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b035bb6c-f444-4457-a791-d99d42e5ed77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2095768609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9060d122-1dea-46cd-9de0-d73f4930daca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef9dc3674d574e7f8931ed6ba9134c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:50Z,use_quota=True,user_id='89a10a4078b94a32a7e02b6eaa68aeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0cde51b-d938-414c-82a7-6354aa2f6337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0cde51b-d938-414c-82a7-6354aa2f6337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278eb985-c4b5-471e-8574-d84108f5ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278eb985-c4b5-471e-8574-d84108f5ea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9060d122-1dea-46cd-9de0-d73f4930daca', 'volume_name': 'volume-9060d122-1dea-46cd-9de0-d73f4930daca', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54151eb1-fcaf-4c88-a45c-186e95a0938c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54151eb1-fcaf-4c88-a45c-186e95a0938c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195d623f-3d07-47d6-9887-6d854d64bcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Volume 9060d122-1dea-46cd-9de0-d73f4930daca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9060d122-1dea-46cd-9de0-d73f4930daca', 'volume_size': 1} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:50 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1.b330d464-3279-46af-b396-b23010db5cd1" returned: 0 in 0.319s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-b330d464-3279-46af-b396-b23010db5cd1" released by "_delete_snapshot" :: held 1.956s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-b1c35965-80ab-4c7e-a475-ec0045505bf1" released by "delete_snapshot" :: held 1.983s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:50 devstack cinder-volume[87069]: WARNING cinder.quota [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1428148548 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1428148548, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] Created reservations ['e5647995-44c7-4d22-a892-3a718ee85604', '03fcb129-44b1-481f-a709-3ac6101803ab', '07daa5b1-faba-40d7-84ce-a1acc7562632', 'de4f3fd8-f9eb-4474-bb42-af359470ba5b'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:50 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b" returned: 0 in 0.253s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-7324c627-cd4f-4127-bc01-500c0be7e711 req-fbd0f392-7881-4a9c-b20e-aa37ad4256c1 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.547s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-7324c627-cd4f-4127-bc01-500c0be7e711 req-fbd0f392-7881-4a9c-b20e-aa37ad4256c1 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.211s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2095768609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9060d122-1dea-46cd-9de0-d73f4930daca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef9dc3674d574e7f8931ed6ba9134c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:50Z,use_quota=True,user_id='89a10a4078b94a32a7e02b6eaa68aeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Creating volume 9060d122-1dea-46cd-9de0-d73f4930daca {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:50 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-39b81e7c-e37c-44e3-958e-56b7888f2790 tempest-SnapshotsActionsTest-113287957 None] Create snapshot completed successfully Nov 06 21:43:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7e356a87-06b1-4354-983c-50c0a05f0cf9 tempest-GroupSnapshotsTest-19394807 None] group_snapshot 5e3ac297-44a4-484c-8c25-72821ab435d1: deleted successfully Nov 06 21:43:50 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca 1073741824 Nov 06 21:43:50 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-7324c627-cd4f-4127-bc01-500c0be7e711 req-fbd0f392-7881-4a9c-b20e-aa37ad4256c1 tempest-ServerActionsTestOtherA-1619012098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-30e7f746-d38f-473f-9300-81461324bb6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e341028-3518-4389-aabb-92ca3270888a', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:43:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-7324c627-cd4f-4127-bc01-500c0be7e711 req-fbd0f392-7881-4a9c-b20e-aa37ad4256c1 tempest-ServerActionsTestOtherA-1619012098 None] attachment_update completed successfully. Nov 06 21:43:50 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca 1073741824" returned: 0 in 0.464s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:51 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca Nov 06 21:43:51 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-0f7d2769-2970-44d1-9bfe-3ab5e58fab8b-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-0f7d2769-2970-44d1-9bfe-3ab5e58fab8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:51 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-quobyte-0f7d2769-2970-44d1-9bfe-3ab5e58fab8b" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca" returned: 0 in 0.533s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (195d623f-3d07-47d6-9887-6d854d64bcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9060d122-1dea-46cd-9de0-d73f4930daca', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84982a2-4395-42ea-bd20-69fa402c64f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-0f7d2769-2970-44d1-9bfe-3ab5e58fab8b" acquired by "_delete_snapshot" :: waited 0.119s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Deleting offline snapshot 0f7d2769-2970-44d1-9bfe-3ab5e58fab8b of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] snapshot_file for this snap is: volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-b1c35965-80ab-4c7e-a475-ec0045505bf1" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:51 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Volume volume-9060d122-1dea-46cd-9de0-d73f4930daca (9060d122-1dea-46cd-9de0-d73f4930daca): created successfully Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84982a2-4395-42ea-bd20-69fa402c64f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Flow 'volume_create_manager' (75a6d1b1-6bcc-4120-b671-cbe9adcababe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5725a669-e673-4556-8c1f-0315b5201c61]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:51 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d3a943c6-1a63-4310-879f-6508fcaa7fc6 tempest-VolumesListTestJSON-785073468 None] Created volume successfully. Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-b1c35965-80ab-4c7e-a475-ec0045505bf1" acquired by "delete_volume" :: waited 0.116s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb65680-33cd-4aff-9a56-669ad9d6de4a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:51 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b Nov 06 21:43:51 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:52 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 Nov 06 21:43:52 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:52 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b" returned: 0 in 0.594s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:52 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6166e98b-ee1d-4305-9e91-ff48f5c40ac0]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:52 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1" returned: 0 in 0.637s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:52 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1 Nov 06 21:43:52 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:52 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:43:52 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:52 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1c35965-80ab-4c7e-a475-ec0045505bf1" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-b1c35965-80ab-4c7e-a475-ec0045505bf1" released by "delete_volume" :: held 1.141s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:52 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.607s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:53 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b Nov 06 21:43:53 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Created reservations ['7a21c030-cbdf-4053-baee-d8ddbccd143d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Flow 'volume_create_manager' (ee906dbd-106d-415b-ba3b-a4af3df219af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8882ed4c-d006-4ec5-bd55-fbaa30fd6a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8882ed4c-d006-4ec5-bd55-fbaa30fd6a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1606098108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98abb41-735e-4f18-97e6-41b4793674de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef9dc3674d574e7f8931ed6ba9134c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:53Z,use_quota=True,user_id='89a10a4078b94a32a7e02b6eaa68aeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1693b6-6c7d-445a-91ab-f9bea43e0df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1693b6-6c7d-445a-91ab-f9bea43e0df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20ba217-887b-47cc-b48e-df4cbba5b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20ba217-887b-47cc-b48e-df4cbba5b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b98abb41-735e-4f18-97e6-41b4793674de', 'volume_name': 'volume-b98abb41-735e-4f18-97e6-41b4793674de', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7ef02f-4241-4012-8cae-2d8e597d1fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7ef02f-4241-4012-8cae-2d8e597d1fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adf76b8-ffb1-4fff-b74f-0266b2019d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Volume b98abb41-735e-4f18-97e6-41b4793674de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b98abb41-735e-4f18-97e6-41b4793674de', 'volume_size': 1} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1606098108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b98abb41-735e-4f18-97e6-41b4793674de,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef9dc3674d574e7f8931ed6ba9134c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:53Z,use_quota=True,user_id='89a10a4078b94a32a7e02b6eaa68aeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Creating volume b98abb41-735e-4f18-97e6-41b4793674de {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:53 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:53 devstack sudo[94962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de 1073741824 Nov 06 21:43:53 devstack sudo[94962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:53 devstack cinder-volume[87069]: WARNING cinder.db.api [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1428148548'] Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Created reservations ['5149efa7-a9c5-4d4a-893c-35ff20f56f04', '26a13f79-ff92-4e54-994c-1d3af81dab82', '6c7b261c-cadd-4070-bca1-dd7649ac2564', 'b9976c99-1387-496e-b9d3-4e6911bdedf6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:53 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b" returned: 0 in 0.653s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:53 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b Nov 06 21:43:53 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:53 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:43:53 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:54 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.0f7d2769-2970-44d1-9bfe-3ab5e58fab8b" returned: 0 in 0.346s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:54 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-0f7d2769-2970-44d1-9bfe-3ab5e58fab8b" released by "_delete_snapshot" :: held 2.460s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" released by "delete_snapshot" :: held 2.617s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d34d73ce-cdf5-4b09-b833-1c3bf5f738d0 tempest-GroupSnapshotsTest-19394807 None] Delete group completed successfully. Nov 06 21:43:54 devstack sudo[94962]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de 1073741824" returned: 0 in 0.758s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Created reservations ['d8fa569f-f151-49f4-bb41-5cddc3f02a82', '848d3c52-eae7-4afe-ae00-58c782ff2f19', 'e36d835c-c65b-4145-a885-b7a2aafe5675', 'ec5d92ad-57d2-4947-826e-29fab59e54f0'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:54 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de Nov 06 21:43:54 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Delete snapshot completed successfully. Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec870ede-d4b1-494c-a691-016f05868e88 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-0f7d2769-2970-44d1-9bfe-3ab5e58fab8b-delete_snapshot" released by "delete_snapshot" :: held 2.920s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:43:54 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de" returned: 0 in 0.372s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adf76b8-ffb1-4fff-b74f-0266b2019d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b98abb41-735e-4f18-97e6-41b4793674de', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9af560-6d13-40e2-b183-71417fe63a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:54 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Volume volume-b98abb41-735e-4f18-97e6-41b4793674de (b98abb41-735e-4f18-97e6-41b4793674de): created successfully Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9af560-6d13-40e2-b183-71417fe63a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Flow 'volume_create_manager' (ee906dbd-106d-415b-ba3b-a4af3df219af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a4394b5b-b5df-4e83-a1e7-1b95e4a39f93 tempest-VolumesListTestJSON-785073468 None] Created volume successfully. Nov 06 21:43:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5e5bc1ba-e74d-4ad7-b9da-7c9c1f7d9b8d tempest-GroupSnapshotsTest-19394807 None] Group tempest-GroupSnapshotsTest-Group-1679473542: creating Nov 06 21:43:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5e5bc1ba-e74d-4ad7-b9da-7c9c1f7d9b8d tempest-GroupSnapshotsTest-19394807 None] Group tempest-GroupSnapshotsTest-Group-1679473542: created successfully Nov 06 21:43:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5e5bc1ba-e74d-4ad7-b9da-7c9c1f7d9b8d tempest-GroupSnapshotsTest-19394807 None] Create group completed successfully. Nov 06 21:43:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Creating offline snapshot b70ac7d0-4f5d-4e36-8042-03aa7ea946dc of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:43:55 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2bb755-a817-4c89-acf2-325a677ade47]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:55 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:43:55 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:55 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.566s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:55 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc 1G Nov 06 21:43:55 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Flow 'volume_create_manager' (86ee699a-11e6-418e-992d-bd1401066719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c17c29-88a0-49f8-b8c0-acb0bf1e501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c17c29-88a0-49f8-b8c0-acb0bf1e501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-750264655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7439a3-29a8-41a8-92bb-8f206c1dc575,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef9dc3674d574e7f8931ed6ba9134c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:56Z,use_quota=True,user_id='89a10a4078b94a32a7e02b6eaa68aeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5eb158-7156-4fa0-a7c3-5aad17ad3973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c5eb158-7156-4fa0-a7c3-5aad17ad3973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c70e36-9744-4cf5-9ca7-6fbf870b5cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c70e36-9744-4cf5-9ca7-6fbf870b5cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d7439a3-29a8-41a8-92bb-8f206c1dc575', 'volume_name': 'volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfe5ad7-b05d-4078-a0ff-b5c4c17e4758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfe5ad7-b05d-4078-a0ff-b5c4c17e4758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea585a7-fcca-4859-938f-169ce079d9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:56 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Volume 5d7439a3-29a8-41a8-92bb-8f206c1dc575: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575', 'volume_size': 1} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:56 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc 1G" returned: 0 in 0.958s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:56 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc Nov 06 21:43:56 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Flow 'volume_create_manager' (bb38e1bb-01ee-4ef5-9ba6-65081e29ee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fa133c-9a6b-4f14-91b3-f5b0ee024110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57fa133c-9a6b-4f14-91b3-f5b0ee024110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1484322635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e14f9bfe-72c1-487c-99f2-969aee5f5103,host='devstack@QuobyteHD#QuobyteHD',id=860fd4a5-9962-4082-9e2e-fa5b9b583727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a34249275e64be7a55282ed4072d673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:57Z,use_quota=True,user_id='91b9f646926a4445a3ba6d22cc724724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ea095ff-9889-4dca-958b-d7db0cb5a5a4),volume_type_id=9ea095ff-9889-4dca-958b-d7db0cb5a5a4)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ddc939-2618-4575-8c0f-2160a197df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ddc939-2618-4575-8c0f-2160a197df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c07121-dc42-4c09-afb4-bb1403493c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c07121-dc42-4c09-afb4-bb1403493c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860fd4a5-9962-4082-9e2e-fa5b9b583727', 'volume_name': 'volume-860fd4a5-9962-4082-9e2e-fa5b9b583727', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ad5869-75a9-45ef-a664-00b0c9c1678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ad5869-75a9-45ef-a664-00b0c9c1678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c15d653-2af2-4e04-82cb-feb10d9c8ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:57 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Volume 860fd4a5-9962-4082-9e2e-fa5b9b583727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860fd4a5-9962-4082-9e2e-fa5b9b583727', 'volume_size': 1} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:57 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc" returned: 0 in 0.553s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:57 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc is being set with open permissions: ugo+rw Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:57 devstack sudo[94999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc Nov 06 21:43:57 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:57 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc" returned: 0 in 0.267s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-750264655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7439a3-29a8-41a8-92bb-8f206c1dc575,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ef9dc3674d574e7f8931ed6ba9134c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:56Z,use_quota=True,user_id='89a10a4078b94a32a7e02b6eaa68aeec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Creating volume 5d7439a3-29a8-41a8-92bb-8f206c1dc575 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:57 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:57 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 1073741824 Nov 06 21:43:57 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:57 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e64d71d4-f3da-4d55-bcea-924f7ea71e9d tempest-SnapshotsActionsTest-113287957 None] Create snapshot completed successfully Nov 06 21:43:58 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 1073741824" returned: 0 in 0.495s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:58 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 Nov 06 21:43:58 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:58 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575" returned: 0 in 0.359s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e14f9bfe-72c1-487c-99f2-969aee5f5103,created_at=2026-11-06T20:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1484322635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e14f9bfe-72c1-487c-99f2-969aee5f5103,host='devstack@QuobyteHD#QuobyteHD',id=860fd4a5-9962-4082-9e2e-fa5b9b583727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a34249275e64be7a55282ed4072d673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:43:57Z,use_quota=True,user_id='91b9f646926a4445a3ba6d22cc724724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ea095ff-9889-4dca-958b-d7db0cb5a5a4),volume_type_id=9ea095ff-9889-4dca-958b-d7db0cb5a5a4)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Creating volume 860fd4a5-9962-4082-9e2e-fa5b9b583727 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:43:58 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea585a7-fcca-4859-938f-169ce079d9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e024b1-9401-4285-8990-4adc5699b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:58 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 1073741824 Nov 06 21:43:58 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:58 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Volume volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 (5d7439a3-29a8-41a8-92bb-8f206c1dc575): created successfully Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e024b1-9401-4285-8990-4adc5699b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Flow 'volume_create_manager' (86ee699a-11e6-418e-992d-bd1401066719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:58 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5c01e4f1-4d33-4e8b-afcb-e56b8865aa5c tempest-VolumesListTestJSON-785073468 None] Created volume successfully. Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-b70ac7d0-4f5d-4e36-8042-03aa7ea946dc-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:58 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:43:58 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-b70ac7d0-4f5d-4e36-8042-03aa7ea946dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-quobyte-b70ac7d0-4f5d-4e36-8042-03aa7ea946dc" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-b70ac7d0-4f5d-4e36-8042-03aa7ea946dc" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Deleting offline snapshot b70ac7d0-4f5d-4e36-8042-03aa7ea946dc of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] snapshot_file for this snap is: volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc9fada-8ab5-4d25-ab98-0d6b82e7fbdb]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:59 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc Nov 06 21:43:59 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:59 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.439s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:43:59 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 1073741824" returned: 0 in 0.825s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:59 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 Nov 06 21:43:59 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:59 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc" returned: 0 in 0.660s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d6ed20-3cfd-4454-940f-a0bf14994fa9]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:43:59 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727" returned: 0 in 0.314s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:43:59 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:43:59 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c15d653-2af2-4e04-82cb-feb10d9c8ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860fd4a5-9962-4082-9e2e-fa5b9b583727', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c5ac15-8432-4b8e-a2f8-04e34cd98df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:43:59 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Volume volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 (860fd4a5-9962-4082-9e2e-fa5b9b583727): created successfully Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00c5ac15-8432-4b8e-a2f8-04e34cd98df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:43:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Flow 'volume_create_manager' (bb38e1bb-01ee-4ef5-9ba6-65081e29ee91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:43:59 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-80b756e5-b563-49a3-8496-f833b6813880 tempest-GroupSnapshotsTest-19394807 None] Created volume successfully. Nov 06 21:44:00 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.441s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:00 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc Nov 06 21:44:00 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:00 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc" returned: 0 in 0.460s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:00 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc Nov 06 21:44:00 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:00 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.b70ac7d0-4f5d-4e36-8042-03aa7ea946dc" returned: 0 in 0.352s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-b70ac7d0-4f5d-4e36-8042-03aa7ea946dc" released by "_delete_snapshot" :: held 2.067s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" released by "delete_snapshot" :: held 2.112s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Created reservations ['3b8a8368-271f-44ba-b362-940f888e657c', '337edcfc-49d0-4380-b1a7-ee717d44a322', '6aef60df-f8da-481d-839f-883272166ee6', 'cb051c43-f25f-4b69-8cc7-38e6e5348702'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:01 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Delete snapshot completed successfully. Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2a698e8f-ed11-4087-b3b0-ed3e864870a1 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-b70ac7d0-4f5d-4e36-8042-03aa7ea946dc-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Flow 'volume_create_manager' (303cba50-0ad9-4db6-9fd8-44e8f4bc3a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c9a411-1446-4978-a118-ca3c147cf9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c9a411-1446-4978-a118-ca3c147cf9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1896413951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e14f9bfe-72c1-487c-99f2-969aee5f5103,host='devstack@QuobyteHD#QuobyteHD',id=0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a34249275e64be7a55282ed4072d673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:01Z,use_quota=True,user_id='91b9f646926a4445a3ba6d22cc724724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ea095ff-9889-4dca-958b-d7db0cb5a5a4),volume_type_id=9ea095ff-9889-4dca-958b-d7db0cb5a5a4)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9edb64b8-e095-4302-b71f-a9d4010b1344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9edb64b8-e095-4302-b71f-a9d4010b1344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b28ba9-ed05-423f-9742-ed558fc1e0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b28ba9-ed05-423f-9742-ed558fc1e0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5', 'volume_name': 'volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2ff936-69fd-413d-82b6-b83542f523df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2ff936-69fd-413d-82b6-b83542f523df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c180559-3a64-4882-bf76-d43e36d848fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:01 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Volume 0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5', 'volume_size': 1} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e14f9bfe-72c1-487c-99f2-969aee5f5103,created_at=2026-11-06T20:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1896413951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e14f9bfe-72c1-487c-99f2-969aee5f5103,host='devstack@QuobyteHD#QuobyteHD',id=0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a34249275e64be7a55282ed4072d673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:01Z,use_quota=True,user_id='91b9f646926a4445a3ba6d22cc724724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ea095ff-9889-4dca-958b-d7db0cb5a5a4),volume_type_id=9ea095ff-9889-4dca-958b-d7db0cb5a5a4)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Creating volume 0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:44:01 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:01 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 1073741824 Nov 06 21:44:01 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:01 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 1073741824" returned: 0 in 0.470s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Acquiring lock "cinder-5d7439a3-29a8-41a8-92bb-8f206c1dc575-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:01 devstack sudo[95050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 Nov 06 21:44:01 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Lock "cinder-5d7439a3-29a8-41a8-92bb-8f206c1dc575-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Acquiring lock "cinder-quobyte-5d7439a3-29a8-41a8-92bb-8f206c1dc575" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Lock "cinder-quobyte-5d7439a3-29a8-41a8-92bb-8f206c1dc575" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc10575-11f6-431d-b5f9-4528044c80b3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:02 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 Nov 06 21:44:02 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:02 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" returned: 0 in 0.354s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c180559-3a64-4882-bf76-d43e36d848fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c1dcbd-7bed-4218-945f-df609d08708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Volume volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 (0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5): created successfully Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c1dcbd-7bed-4218-945f-df609d08708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Flow 'volume_create_manager' (303cba50-0ad9-4db6-9fd8-44e8f4bc3a9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7129125d-7cd3-416e-8b71-dd9db5a8c42a tempest-GroupSnapshotsTest-19394807 None] Created volume successfully. Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Creating offline snapshot 7bb16827-03bd-4752-b4f8-242106c76c74 of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d746e1f6-3c5f-4a1d-8c0e-16597f3fa6ab]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:02 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575" returned: 0 in 0.583s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8a418e26-296d-4fcc-8e25-3a8b0a2eb0f3 tempest-GroupSnapshotsTest-19394807 None] Update group completed successfully. Nov 06 21:44:02 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575 Nov 06 21:44:02 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:02 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:44:02 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:02 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d7439a3-29a8-41a8-92bb-8f206c1dc575" returned: 0 in 0.252s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Lock "cinder-quobyte-5d7439a3-29a8-41a8-92bb-8f206c1dc575" released by "delete_volume" :: held 0.913s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Created reservations ['ffd2939c-eace-49fe-be0e-6aa8cbdf4f6e', '280135af-6435-4b61-ac28-3427cdccb88a', 'f29cf457-6c7c-4159-8dde-6defa87d9127', 'd3cdfbde-10d4-4173-a01b-4de4c86e8893'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:03 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.468s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:03 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 1G Nov 06 21:44:03 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:03 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:03 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Acquiring lock "cinder-b98abb41-735e-4f18-97e6-41b4793674de-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Lock "cinder-b98abb41-735e-4f18-97e6-41b4793674de-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Acquiring lock "cinder-quobyte-b98abb41-735e-4f18-97e6-41b4793674de" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Lock "cinder-quobyte-b98abb41-735e-4f18-97e6-41b4793674de" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbdcffa-4868-44f2-82e0-52df228c7675]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:03 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.358s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Deleted volume successfully. Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8552622e-5ea9-46ff-9aa9-33612d56ed0d tempest-VolumesListTestJSON-785073468 None] Lock "cinder-5d7439a3-29a8-41a8-92bb-8f206c1dc575-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:03 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de Nov 06 21:44:03 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:03 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 1G" returned: 0 in 0.631s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:03 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 Nov 06 21:44:03 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4d018bbf-95d0-4d71-8435-4aebc9037c93 tempest-GroupSnapshotsTest-19394807 None] Update group completed successfully. Nov 06 21:44:03 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de" returned: 0 in 0.519s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:04 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de Nov 06 21:44:04 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:04 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:04 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 is being set with open permissions: ugo+rw Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:04 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 Nov 06 21:44:04 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:04 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b98abb41-735e-4f18-97e6-41b4793674de" returned: 0 in 0.259s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Lock "cinder-quobyte-b98abb41-735e-4f18-97e6-41b4793674de" released by "delete_volume" :: held 0.823s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Created reservations ['188acf04-9aad-4d14-9e1d-1e09be24eef3', '42d77b45-cda7-4297-b7c2-dcbb6c16acc0', 'f774e9d4-de95-4d42-bc98-6b8a0f641425', '16849d17-0f3d-4693-9ddc-71ae6cda56a7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:04 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74" returned: 0 in 0.264s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0da0dae7-6c86-43f0-bfab-4132c7584819 tempest-SnapshotsActionsTest-113287957 None] Create snapshot completed successfully Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:04 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:04 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Acquiring lock "cinder-9060d122-1dea-46cd-9de0-d73f4930daca-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Lock "cinder-9060d122-1dea-46cd-9de0-d73f4930daca-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Acquiring lock "cinder-quobyte-9060d122-1dea-46cd-9de0-d73f4930daca" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:04 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.308s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Lock "cinder-quobyte-9060d122-1dea-46cd-9de0-d73f4930daca" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Deleted volume successfully. Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce04cce-d188-43e8-99f5-c283c2c9ac04]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1764362-bbeb-4467-aa6d-9dec79ea1439 tempest-VolumesListTestJSON-785073468 None] Lock "cinder-b98abb41-735e-4f18-97e6-41b4793674de-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-7bb16827-03bd-4752-b4f8-242106c76c74-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-7bb16827-03bd-4752-b4f8-242106c76c74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:04 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-quobyte-7bb16827-03bd-4752-b4f8-242106c76c74" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:04 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-7bb16827-03bd-4752-b4f8-242106c76c74" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Deleting offline snapshot 7bb16827-03bd-4752-b4f8-242106c76c74 of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] snapshot_file for this snap is: volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[001a2086-3dbb-4c43-b66b-e23ab1b78eaf]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:05 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-098e55e2-6dee-4692-ad33-40347339f93e tempest-GroupSnapshotsTest-19394807 None] Update group completed successfully. Nov 06 21:44:05 devstack sudo[95097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 Nov 06 21:44:05 devstack sudo[95097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:05 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca" returned: 0 in 0.538s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:05 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca Nov 06 21:44:05 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:05 devstack sudo[95097]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74" returned: 0 in 0.436s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bdac7d-0735-44a4-bb99-d348b7dd65e2]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:05 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9060d122-1dea-46cd-9de0-d73f4930daca" returned: 0 in 0.294s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Lock "cinder-quobyte-9060d122-1dea-46cd-9de0-d73f4930daca" released by "delete_volume" :: held 0.885s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:05 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:44:05 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Created reservations ['871f8a9f-27c2-4309-a12a-2ec4d07df4d6', 'dd0c3047-c0f9-4140-95df-e4a20385ba08', '089c1c0b-1342-41d5-84df-2dfedbaee0b4', '62fcf334-8fc9-4f43-b257-795f13fcc381'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:05 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:05 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:05 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.436s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:05 devstack sudo[95115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 Nov 06 21:44:05 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:06 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Deleted volume successfully. Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:INSERT=42,cinder:UPDATE=154,cinder:SELECT=133,cinder:DELETE=13 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c3a60e5c-d7d0-4fa1-9dd0-be4d5687392f tempest-VolumesListTestJSON-785073468 None] Lock "cinder-9060d122-1dea-46cd-9de0-d73f4930daca-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=163,cinder:INSERT=39,cinder:UPDATE=143,cinder:DELETE=9 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:44:06 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74" returned: 0 in 0.449s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:06 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74 Nov 06 21:44:06 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f175a923-945f-4743-a46d-0873053ab5b3 tempest-GroupSnapshotsTest-19394807 None] Update group completed successfully. Nov 06 21:44:06 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.7bb16827-03bd-4752-b4f8-242106c76c74" returned: 0 in 0.275s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-7bb16827-03bd-4752-b4f8-242106c76c74" released by "_delete_snapshot" :: held 1.749s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" released by "delete_snapshot" :: held 1.778s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Created reservations ['156faf6f-c491-4c87-bb29-81bb9d2f9b06', '9f9f0fc7-fc3e-479f-96bd-ecb8ec1d2875', '60baf076-151e-4a04-8462-11f48d63bdc3', '535ee2e5-9c76-479f-9078-cff12ebf9446'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Delete snapshot completed successfully. Nov 06 21:44:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c93bfed5-703b-4c96-84e3-a9364f1e8cb5 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-7bb16827-03bd-4752-b4f8-242106c76c74-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Creating offline snapshot 9a790338-cc46-4aed-a4ac-ecab56ac5dd3 of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:44:07 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6a8ad0-cb87-4d8b-ae2f-fa3b51883a18]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:07 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:44:07 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.531s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:08 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:08 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 1G Nov 06 21:44:08 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] GroupSnapshot 8fb30b4a-37c6-4c36-861a-ee2b82920ed9: creating. Nov 06 21:44:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Group snapshot 8fb30b4a-37c6-4c36-861a-ee2b82920ed9: creating. {{(pid=87069) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 21:44:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:08 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 1G" returned: 0 in 0.595s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:08 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 Nov 06 21:44:08 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:09 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3" returned: 0 in 0.409s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:09 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 is being set with open permissions: ugo+rw Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:09 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 Nov 06 21:44:09 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:09 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3" returned: 0 in 0.322s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.999s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.252s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Creating offline snapshot a3ea0363-62b8-4c8b-927f-8650851c473b of volume 860fd4a5-9962-4082-9e2e-fa5b9b583727 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:44:09 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4ffb4a62-8c10-4488-805d-f8022a543cd9 tempest-SnapshotsActionsTest-113287957 None] Create snapshot completed successfully Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d7e80a-5f98-429b-96a6-7214161331a3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:09 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 Nov 06 21:44:09 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:09 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727" returned: 0 in 0.441s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:09 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b 1G Nov 06 21:44:09 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:10 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b 1G" returned: 0 in 0.529s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:10 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b Nov 06 21:44:10 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-9a790338-cc46-4aed-a4ac-ecab56ac5dd3-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-9a790338-cc46-4aed-a4ac-ecab56ac5dd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:10 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b" returned: 0 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:10 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Acquiring lock "cinder-quobyte-9a790338-cc46-4aed-a4ac-ecab56ac5dd3" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-9a790338-cc46-4aed-a4ac-ecab56ac5dd3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:10 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b Nov 06 21:44:10 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Deleting offline snapshot 9a790338-cc46-4aed-a4ac-ecab56ac5dd3 of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] snapshot_file for this snap is: volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3d46a7-866a-416b-b4bc-8a8c09ac7f1e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:11 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 Nov 06 21:44:11 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:11 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b" returned: 0 in 0.321s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:11 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.info Nov 06 21:44:11 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:11 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3" returned: 0 in 0.485s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f48d77-d0ef-4c87-ac85-11f3f0904187]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:11 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.info" returned: 0 in 0.333s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:11 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:11 devstack sudo[95209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.info Nov 06 21:44:11 devstack sudo[95209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:11 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:44:11 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:11 devstack sudo[95209]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.info" returned: 0 in 0.266s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.395s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Creating offline snapshot bd6bfead-50ac-4672-9c06-20eba342d2ed of volume 0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c33f64a-eaf3-4301-b9fc-730b079c6359]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:11 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.429s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:11 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 Nov 06 21:44:11 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:11 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 Nov 06 21:44:11 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:12 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" returned: 0 in 0.414s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:12 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3" returned: 0 in 0.412s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:12 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed 1G Nov 06 21:44:12 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:12 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3 Nov 06 21:44:12 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:12 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.9a790338-cc46-4aed-a4ac-ecab56ac5dd3" returned: 0 in 0.276s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-9a790338-cc46-4aed-a4ac-ecab56ac5dd3" released by "_delete_snapshot" :: held 1.737s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" released by "delete_snapshot" :: held 1.770s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Created reservations ['fe6c3c93-af3c-4310-97dc-8399ad457acb', '0d369ed1-57f6-412d-b451-1b0623f0efce', 'f1e3b910-e111-4238-9cf2-f85d53d59dd2', '88697a46-a6a1-44d6-81db-1e13da4ce1b4'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:12 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Delete snapshot completed successfully. Nov 06 21:44:12 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c33081e-27b0-466d-a8d7-2c5841f4f003 tempest-SnapshotsActionsTest-365607538 None] Lock "cinder-9a790338-cc46-4aed-a4ac-ecab56ac5dd3-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed 1G" returned: 0 in 0.494s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:12 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed Nov 06 21:44:12 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:13 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:13 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:13 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed Nov 06 21:44:13 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:13 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:13 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.info Nov 06 21:44:13 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "cinder-50082a10-e004-469d-b380-ce3ba712437f-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-50082a10-e004-469d-b380-ce3ba712437f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:13 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.info" returned: 0 in 0.341s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:13 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "cinder-quobyte-50082a10-e004-469d-b380-ce3ba712437f" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:13 devstack sudo[95249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.info Nov 06 21:44:13 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-quobyte-50082a10-e004-469d-b380-ce3ba712437f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Deleting offline snapshot 50082a10-e004-469d-b380-ce3ba712437f of volume dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] snapshot_file for this snap is: volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e9ce52-7ed0-4e79-b785-111e2b809ec7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:13 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:44:13 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:14 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.info" returned: 0 in 0.266s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cbb4c2f3-66b8-4471-9e74-e1e46f47a53b tempest-GroupSnapshotsTest-19394807 None] group_snapshot 8fb30b4a-37c6-4c36-861a-ee2b82920ed9: created successfully Nov 06 21:44:14 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.378s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[369f8280-68b8-4cbf-a770-96fc746156d3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:14 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b Nov 06 21:44:14 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] group_snapshot 8fb30b4a-37c6-4c36-861a-ee2b82920ed9: deleting Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] group_snapshot 8fb30b4a-37c6-4c36-861a-ee2b82920ed9: deleting {{(pid=87069) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-860fd4a5-9962-4082-9e2e-fa5b9b583727" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-860fd4a5-9962-4082-9e2e-fa5b9b583727" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-a3ea0363-62b8-4c8b-927f-8650851c473b" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:14 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-a3ea0363-62b8-4c8b-927f-8650851c473b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Deleting offline snapshot a3ea0363-62b8-4c8b-927f-8650851c473b of volume 860fd4a5-9962-4082-9e2e-fa5b9b583727 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] snapshot_file for this snap is: volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" returned: 0 in 0.453s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0fb9d3-e5dc-4416-8899-dbf795ae27ba]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:14 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:44:14 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:14 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b Nov 06 21:44:14 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:15 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b" returned: 0 in 0.447s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-860fd4a5-9962-4082-9e2e-fa5b9b583727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:15 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.496s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7193e7-a69e-40cf-96d1-54d96b841c98]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:15 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f Nov 06 21:44:15 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:15 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 Nov 06 21:44:15 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:15 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b.50082a10-e004-469d-b380-ce3ba712437f" returned: 0 in 0.284s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-quobyte-50082a10-e004-469d-b380-ce3ba712437f" released by "_delete_snapshot" :: held 1.760s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" released by "delete_snapshot" :: held 1.788s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Created reservations ['79544af7-f1c8-4bce-897e-ac2cb3e7e391', '1a83088b-98c3-4f25-aaf3-af0771ffbad3', 'd2ab7cf5-5411-4ade-ad52-3216e814a1f0', '9b1a2f98-6855-4f3e-9469-ede65ff737cf'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:15 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727" returned: 0 in 0.484s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:15 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b Nov 06 21:44:15 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:15 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Delete snapshot completed successfully. Nov 06 21:44:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f66e875-699f-4061-aaf1-362293d1e701 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-50082a10-e004-469d-b380-ce3ba712437f-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "cinder-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:16 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b" returned: 0 in 0.668s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[245337c8-fc53-4136-b349-149497ee0822]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:16 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b Nov 06 21:44:16 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:16 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b Nov 06 21:44:16 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:16 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727.a3ea0363-62b8-4c8b-927f-8650851c473b" returned: 0 in 0.337s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-a3ea0363-62b8-4c8b-927f-8650851c473b" released by "_delete_snapshot" :: held 2.078s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-860fd4a5-9962-4082-9e2e-fa5b9b583727" released by "delete_snapshot" :: held 2.106s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-bd6bfead-50ac-4672-9c06-20eba342d2ed" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-bd6bfead-50ac-4672-9c06-20eba342d2ed" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Deleting offline snapshot bd6bfead-50ac-4672-9c06-20eba342d2ed of volume 0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] snapshot_file for this snap is: volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e297f5-d361-4f63-9f15-7fe1e5d0e6b4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:17 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed Nov 06 21:44:17 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:17 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" returned: 0 in 0.773s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:17 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b Nov 06 21:44:17 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:17 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed" returned: 0 in 0.553s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25c5685-d13c-4aa8-9fcd-eb3bb53b0ce9]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:17 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" returned: 0 in 0.493s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:17 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 Nov 06 21:44:17 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-quobyte-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b" released by "delete_volume" :: held 1.411s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Created reservations ['f16b5a98-be61-4ed6-93f3-bc1078ba6d74', '88f6b92e-6475-4524-8bc6-5d99412f0630', '2640e796-1859-44ba-8a3d-2ee944f5c168', '4feae367-9bd9-439d-ae8e-b04fab61c889'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:18 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:18 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:18 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" returned: 0 in 0.789s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:18 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed Nov 06 21:44:18 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:18 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.527s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:18 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Deleted volume successfully. Nov 06 21:44:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-487d9889-195e-467c-b82e-2154e7112109 tempest-SnapshotsActionsTest-113287957 None] Lock "cinder-dfb7bbb4-4aee-4baa-8f90-d6d5b2bbf38b-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:18 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed" returned: 0 in 0.550s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:18 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed Nov 06 21:44:18 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:19 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5.bd6bfead-50ac-4672-9c06-20eba342d2ed" returned: 0 in 0.333s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-bd6bfead-50ac-4672-9c06-20eba342d2ed" released by "_delete_snapshot" :: held 2.380s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" released by "delete_snapshot" :: held 2.410s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:19 devstack cinder-volume[87069]: WARNING cinder.quota [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-574939808 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-574939808, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:44:19 devstack cinder-volume[87069]: WARNING cinder.quota [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-574939808 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-574939808, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:44:19 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Created reservations ['9b8c7e09-abf9-46cf-a67c-bd065a9e84d1', 'f8cf8aea-b16c-4fc5-a92a-c1b8cfcbaf25', '3caecb96-c9bc-487f-b0c6-298e88b78791', 'bdd60a9f-a5c6-48fe-9e9c-a524e3440067'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:19 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] Created reservations ['b24dbd6a-5ce1-47bf-bcfc-fb20c62703c4', '89ed01a0-16dd-490f-ae28-4ac470d811bd', 'ad87858b-c6af-4f9f-97fd-8143d0a8c990', '0965fadb-5bc9-4ce6-b933-2d9fed3ebde5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-875c44dd-4988-4e32-8f19-b66acc5f86ea tempest-GroupSnapshotsTest-19394807 None] group_snapshot 8fb30b4a-37c6-4c36-861a-ee2b82920ed9: deleted successfully Nov 06 21:44:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" acquired by "delete_volume" :: waited 0.031s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c972a0-e048-4526-92b1-3eaecc108528]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:20 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 Nov 06 21:44:20 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:21 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" returned: 0 in 0.581s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:21 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5 Nov 06 21:44:21 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:21 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" returned: 0 in 0.437s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-0e7e2ea5-f6fa-423d-bd9b-602c4cf84ad5" released by "delete_volume" :: held 1.100s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-860fd4a5-9962-4082-9e2e-fa5b9b583727" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-860fd4a5-9962-4082-9e2e-fa5b9b583727" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:21 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ec189d-13d1-4bb0-afed-534582b6724d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:22 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 Nov 06 21:44:22 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:22 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727" returned: 0 in 0.589s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:22 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727 Nov 06 21:44:22 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:23 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-860fd4a5-9962-4082-9e2e-fa5b9b583727" returned: 0 in 0.541s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-860fd4a5-9962-4082-9e2e-fa5b9b583727" released by "delete_volume" :: held 1.252s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Created reservations ['b92498fe-58e7-42c0-9963-a58727089431'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:23 devstack cinder-volume[87069]: WARNING cinder.quota [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-574939808 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-574939808, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Created reservations ['a496d047-8de3-4165-88dc-c0b231592520', '8ea1633c-4661-43b5-adf9-a0bc2475191a', 'b0c9d267-f409-4f75-9a43-4499c73ff033', '48409ee3-41ae-4046-ad47-253c49fb6084'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Created reservations ['8ab9e951-6b81-4261-93a0-6cb1522764dc', 'd89f6926-7676-4549-b4a8-ee54215d8d08', '6b9a5b00-6ed6-4feb-8872-7e83a38ac503', '3a6660a2-accc-4dd7-a3bf-b7cf2c8e77ea'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:23 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:23 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:24 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.482s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c2177e61-1374-47af-b629-7ca9a49ee8e4 tempest-GroupSnapshotsTest-19394807 None] Delete group completed successfully. Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (5ca49e9b-61fc-4dbf-8b3c-67241a7fa5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b68424b-9ccb-4a22-9497-30358eeff3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b68424b-9ccb-4a22-9497-30358eeff3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545163090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44653783-b52c-4791-a7f9-f1ddfe724845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ae466a6cb24c6b901523eae28960bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:24Z,use_quota=True,user_id='1f10527616ea4f75be9ddb76ba171784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36f16ad-27b2-4a72-a53e-0da2a5a536a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b36f16ad-27b2-4a72-a53e-0da2a5a536a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e653b54e-fda7-45ed-b8f7-ef86749b19e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e653b54e-fda7-45ed-b8f7-ef86749b19e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44653783-b52c-4791-a7f9-f1ddfe724845', 'volume_name': 'volume-44653783-b52c-4791-a7f9-f1ddfe724845', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9834f7e2-3f3d-4f8a-b47a-93a58cc3fef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9834f7e2-3f3d-4f8a-b47a-93a58cc3fef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99117b6-2570-4aaf-a0e2-e3b7da42b5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:24 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume 44653783-b52c-4791-a7f9-f1ddfe724845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44653783-b52c-4791-a7f9-f1ddfe724845', 'volume_size': 1} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1545163090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44653783-b52c-4791-a7f9-f1ddfe724845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ae466a6cb24c6b901523eae28960bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:24Z,use_quota=True,user_id='1f10527616ea4f75be9ddb76ba171784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Creating volume 44653783-b52c-4791-a7f9-f1ddfe724845 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:44:24 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:24 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 1073741824 Nov 06 21:44:24 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-9ee99048-775f-454f-bf60-6185e62147ce req-6a46fe71-d604-4ead-a8e5-02850af4e2a5 tempest-ServerActionsTestOtherA-1619012098 None] Terminate volume connection completed successfully. Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-9ee99048-775f-454f-bf60-6185e62147ce req-6a46fe71-d604-4ead-a8e5-02850af4e2a5 tempest-ServerActionsTestOtherA-1619012098 None] Deleting attachment 3e341028-3518-4389-aabb-92ca3270888a. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:44:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "cinder-30e7f746-d38f-473f-9300-81461324bb6e-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Lock "cinder-30e7f746-d38f-473f-9300-81461324bb6e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "cinder-quobyte-30e7f746-d38f-473f-9300-81461324bb6e" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Lock "cinder-quobyte-30e7f746-d38f-473f-9300-81461324bb6e" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf88b88-e848-4e07-adb8-95e7111bd46e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:25 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 1073741824" returned: 0 in 0.594s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:25 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 Nov 06 21:44:25 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:25 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e Nov 06 21:44:25 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-14a0bd2e-bb27-4edb-9156-8403364d4daa tempest-GroupSnapshotsTest-19394807 None] Group tempest-GroupSnapshotsTest-Group-99570214: creating Nov 06 21:44:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-14a0bd2e-bb27-4edb-9156-8403364d4daa tempest-GroupSnapshotsTest-19394807 None] Group tempest-GroupSnapshotsTest-Group-99570214: created successfully Nov 06 21:44:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-14a0bd2e-bb27-4edb-9156-8403364d4daa tempest-GroupSnapshotsTest-19394807 None] Create group completed successfully. Nov 06 21:44:25 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845" returned: 0 in 0.423s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99117b6-2570-4aaf-a0e2-e3b7da42b5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44653783-b52c-4791-a7f9-f1ddfe724845', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1a5988-ee1f-4e15-8734-c01bce950616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:25 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume volume-44653783-b52c-4791-a7f9-f1ddfe724845 (44653783-b52c-4791-a7f9-f1ddfe724845): created successfully Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d1a5988-ee1f-4e15-8734-c01bce950616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (5ca49e9b-61fc-4dbf-8b3c-67241a7fa5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8e6773db-a60e-4ac4-a248-f6caa1089d77 tempest-VolumesSnapshotTestJSON-1136938097 None] Created volume successfully. Nov 06 21:44:25 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e" returned: 0 in 0.648s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:25 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e Nov 06 21:44:25 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:26 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-30e7f746-d38f-473f-9300-81461324bb6e" returned: 0 in 0.270s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Lock "cinder-quobyte-30e7f746-d38f-473f-9300-81461324bb6e" released by "delete_volume" :: held 0.993s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG cinder.quota [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Created reservations ['c79c8b03-451e-4de4-9909-5d6e34d0cea8', 'e99b8dbb-d95b-43ca-9145-4c6087753784', 'c70868d9-37b7-4c21-b141-0a1367434f49', 'b6bbb4f9-8c87-4202-98ef-355ecd42b234'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:26 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:26 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:26 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.258s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG cinder.manager [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Deleted volume successfully. Nov 06 21:44:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-9ee99048-775f-454f-bf60-6185e62147ce req-87089c65-8881-4822-956d-fa298ba724f3 tempest-ServerActionsTestOtherA-1619012098 None] Lock "cinder-30e7f746-d38f-473f-9300-81461324bb6e-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Flow 'volume_create_manager' (1186a9b7-3e88-465f-bcf8-c935904542ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3345d39f-0f27-4694-8e38-d213c702cbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "cinder-836fcd62-50eb-4578-8966-04cb26f3088b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3345d39f-0f27-4694-8e38-d213c702cbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211037779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a061978-299c-485d-8c68-18c4b10ae39d,host='devstack@QuobyteHD#QuobyteHD',id=2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a34249275e64be7a55282ed4072d673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:27Z,use_quota=True,user_id='91b9f646926a4445a3ba6d22cc724724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99fd059d-4295-4f69-9299-a54e0f23449d),volume_type_id=99fd059d-4295-4f69-9299-a54e0f23449d)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c6da7f-0dec-47aa-8c73-f72ba55a2eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4c6da7f-0dec-47aa-8c73-f72ba55a2eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2dbaa69-e8b2-4165-878f-ccc8f5721e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2dbaa69-e8b2-4165-878f-ccc8f5721e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80', 'volume_name': 'volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b115eeec-efa6-4248-953b-28fac128bfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b115eeec-efa6-4248-953b-28fac128bfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0e1162-0412-43e9-bffb-636a420170da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:27 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Volume 2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80', 'volume_size': 1} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9a061978-299c-485d-8c68-18c4b10ae39d,created_at=2026-11-06T20:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211037779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9a061978-299c-485d-8c68-18c4b10ae39d,host='devstack@QuobyteHD#QuobyteHD',id=2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a34249275e64be7a55282ed4072d673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:27Z,use_quota=True,user_id='91b9f646926a4445a3ba6d22cc724724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99fd059d-4295-4f69-9299-a54e0f23449d),volume_type_id=99fd059d-4295-4f69-9299-a54e0f23449d)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Creating volume 2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:44:27 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Lock "cinder-836fcd62-50eb-4578-8966-04cb26f3088b-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:27 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 1073741824 Nov 06 21:44:27 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "cinder-quobyte-836fcd62-50eb-4578-8966-04cb26f3088b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Lock "cinder-quobyte-836fcd62-50eb-4578-8966-04cb26f3088b" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d0b247-f355-4a4e-a13f-0469cc8959bb]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:27 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b Nov 06 21:44:27 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:27 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 1073741824" returned: 0 in 0.574s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:27 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b" returned: 0 in 0.472s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:27 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b Nov 06 21:44:27 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:27 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 Nov 06 21:44:27 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Flow 'volume_create_manager' (e2ebce9d-47de-42a6-904e-6b4d7c138e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73b9165-6af3-4b3a-a906-a35a918eea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:28 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73b9165-6af3-4b3a-a906-a35a918eea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2005807145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5fdc3f-7f0c-4f16-b509-f00589f69d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d93e7fafb2c4c06886a60c07c5331a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:28Z,use_quota=True,user_id='09b13bb68a6f47d48082d19313042c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:28 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705cfbdf-bb85-471e-a851-ac04ec3175b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (705cfbdf-bb85-471e-a851-ac04ec3175b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf90dc6a-5b28-4e03-978e-44b2afa08460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf90dc6a-5b28-4e03-978e-44b2afa08460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5fdc3f-7f0c-4f16-b509-f00589f69d6f', 'volume_name': 'volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc58356-7fd9-4ece-9aa5-ce15aade4004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc58356-7fd9-4ece-9aa5-ce15aade4004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b569a9-6716-44a2-842b-fc835e557324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:28 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Volume eb5fdc3f-7f0c-4f16-b509-f00589f69d6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f', 'volume_size': 1} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" returned: 0 in 0.311s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-836fcd62-50eb-4578-8966-04cb26f3088b" returned: 0 in 0.327s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.475s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0e1162-0412-43e9-bffb-636a420170da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9490f71-6379-46ab-a23b-6f66428007b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Lock "cinder-quobyte-836fcd62-50eb-4578-8966-04cb26f3088b" released by "delete_volume" :: held 0.876s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Creating offline snapshot f19de3b6-c51d-4019-9652-abb6a36e6044 of volume 44653783-b52c-4791-a7f9-f1ddfe724845 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:44:28 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Volume volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 (2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80): created successfully Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9490f71-6379-46ab-a23b-6f66428007b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Flow 'volume_create_manager' (1186a9b7-3e88-465f-bcf8-c935904542ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[90618729-f5de-4789-86fb-fde4504a3a4d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2629fad4-5a33-43c3-8fe3-f1de7513434d tempest-GroupSnapshotsTest-19394807 None] Created volume successfully. Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Created reservations ['08420dea-5ed0-41ee-92ad-ed35de242f96', '8a680991-5f34-44ff-8279-2604b53c77c4', '91606129-8e76-488c-a60c-ebf08314f939', 'd2c27f7c-3ce4-4992-9e18-d7484c3ec786'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:28 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 Nov 06 21:44:28 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:28 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:28 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:28 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845" returned: 0 in 0.466s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:28 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.397s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:28 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 1G Nov 06 21:44:28 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] GroupSnapshot 5835158b-d147-4d19-b2e6-e2b6ceb16c75: creating. Nov 06 21:44:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Deleted volume successfully. Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Group snapshot 5835158b-d147-4d19-b2e6-e2b6ceb16c75: creating. {{(pid=87069) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-113ad2d7-27a5-4d97-9833-342c22119938 tempest-ServerActionsTestOtherA-1619012098 None] Lock "cinder-836fcd62-50eb-4578-8966-04cb26f3088b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:29 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 1G" returned: 0 in 0.650s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44653783-b52c-4791-a7f9-f1ddfe724845 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:29 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44653783-b52c-4791-a7f9-f1ddfe724845 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 Nov 06 21:44:29 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:29 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44653783-b52c-4791-a7f9-f1ddfe724845 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044" returned: 0 in 0.295s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:29 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 is being set with open permissions: ugo+rw Nov 06 21:44:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:29 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 Nov 06 21:44:29 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:29 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:30 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.info Nov 06 21:44:30 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:30 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.info" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:30 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.info is being set with open permissions: ugo+rw Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:30 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.info Nov 06 21:44:30 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:30 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.info" returned: 0 in 0.253s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.432s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2005807145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5fdc3f-7f0c-4f16-b509-f00589f69d6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d93e7fafb2c4c06886a60c07c5331a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:28Z,use_quota=True,user_id='09b13bb68a6f47d48082d19313042c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Creating volume eb5fdc3f-7f0c-4f16-b509-f00589f69d6f {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:44:30 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:44:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:30 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f 1073741824 Nov 06 21:44:30 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4924ae2f-e12b-40b0-b2ac-1f626fe89591 tempest-VolumesSnapshotTestJSON-1136938097 None] Create snapshot completed successfully Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-f19de3b6-c51d-4019-9652-abb6a36e6044-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-f19de3b6-c51d-4019-9652-abb6a36e6044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-44653783-b52c-4791-a7f9-f1ddfe724845" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-44653783-b52c-4791-a7f9-f1ddfe724845" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-f19de3b6-c51d-4019-9652-abb6a36e6044" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f19de3b6-c51d-4019-9652-abb6a36e6044" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Deleting offline snapshot f19de3b6-c51d-4019-9652-abb6a36e6044 of volume 44653783-b52c-4791-a7f9-f1ddfe724845 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] snapshot_file for this snap is: volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:31 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b10d489-c146-400f-894c-624f7448f290]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f 1073741824" returned: 0 in 0.504s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:31 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f Nov 06 21:44:31 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:31 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 Nov 06 21:44:31 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:31 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" returned: 0 in 0.261s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.589s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b569a9-6716-44a2-842b-fc835e557324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bb1203-3520-4815-89bc-61c4e5223ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Creating offline snapshot 3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 of volume 2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:44:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Volume volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f (eb5fdc3f-7f0c-4f16-b509-f00589f69d6f): created successfully Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82bb1203-3520-4815-89bc-61c4e5223ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Flow 'volume_create_manager' (e2ebce9d-47de-42a6-904e-6b4d7c138e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9171f1-4998-4c04-97fb-b035d7e11a8a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:31 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044" returned: 0 in 0.414s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44653783-b52c-4791-a7f9-f1ddfe724845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:31 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-37f63409-138d-4e88-aa40-d1069c593d3b tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Created volume successfully. Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc39054-624e-486a-9792-f14b78372dae]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:31 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 Nov 06 21:44:31 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:31 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 Nov 06 21:44:31 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:31 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" returned: 0 in 0.437s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:31 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 1G Nov 06 21:44:31 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:32 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845" returned: 0 in 0.480s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:32 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 Nov 06 21:44:32 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:32 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 1G" returned: 0 in 0.489s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:32 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 Nov 06 21:44:32 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:32 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044" returned: 0 in 0.471s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:32 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044 Nov 06 21:44:32 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:32 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92" returned: 0 in 0.338s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:32 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:32 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845.f19de3b6-c51d-4019-9652-abb6a36e6044" returned: 0 in 0.275s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:32 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 Nov 06 21:44:32 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f19de3b6-c51d-4019-9652-abb6a36e6044" released by "_delete_snapshot" :: held 1.769s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-44653783-b52c-4791-a7f9-f1ddfe724845" released by "delete_snapshot" :: held 1.791s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Created reservations ['a16b2bb5-85ae-4f8d-b3a1-4269adfdddbb', '3e28cfaa-9758-4c2d-98dd-17a69fb45135', '17ec4f75-cd37-4313-bf09-207e4d8e0690', 'f5bf45c7-4f24-4339-b75f-9ff4f2679956'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Delete snapshot completed successfully. Nov 06 21:44:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-061829b8-341c-4c8f-8b87-1c9d5aa7d91d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-f19de3b6-c51d-4019-9652-abb6a36e6044-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:33 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92" returned: 0 in 0.285s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:33 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.info Nov 06 21:44:33 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:33 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.info" returned: 0 in 0.295s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:33 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:33 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.info Nov 06 21:44:33 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:33 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.info" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.094s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Creating offline snapshot d4ea1b13-bacb-410a-a25a-e980cea0d7a1 of volume eb5fdc3f-7f0c-4f16-b509-f00589f69d6f {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5750f0f9-b813-4090-9e5a-6e202b898c91]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (bc636bd8-4c6e-48e3-9ded-cfb9459689c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbf303f-7de9-4006-be0d-c4cdad1f99fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:33 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-627b3ea3-734e-476e-82dd-ae2885a5cd65 tempest-GroupSnapshotsTest-19394807 None] group_snapshot 5835158b-d147-4d19-b2e6-e2b6ceb16c75: created successfully Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbf303f-7de9-4006-be0d-c4cdad1f99fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-16934224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606dc429-53a1-418a-a4fa-8a5d0e1677c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ae466a6cb24c6b901523eae28960bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:34Z,use_quota=True,user_id='1f10527616ea4f75be9ddb76ba171784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a703f34f-870b-4d15-8c19-534927ef4df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:33 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f Nov 06 21:44:33 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a703f34f-870b-4d15-8c19-534927ef4df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21622701-8f53-45c8-a0fa-1841bfcc3ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21622701-8f53-45c8-a0fa-1841bfcc3ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606dc429-53a1-418a-a4fa-8a5d0e1677c6', 'volume_name': 'volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28da76ad-0a4f-4ca6-882d-1c3591b3ae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28da76ad-0a4f-4ca6-882d-1c3591b3ae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fa9362-1775-4ee8-8bb6-873dc201911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:33 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume 606dc429-53a1-418a-a4fa-8a5d0e1677c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6', 'volume_size': 1} Nov 06 21:44:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:34 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" returned: 0 in 0.420s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:34 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 1G Nov 06 21:44:34 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:34 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] group_snapshot 5835158b-d147-4d19-b2e6-e2b6ceb16c75: deleting Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] group_snapshot 5835158b-d147-4d19-b2e6-e2b6ceb16c75: deleting {{(pid=87069) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-3e0c18f4-5b5c-49ad-b1e5-334e3444dd92" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-3e0c18f4-5b5c-49ad-b1e5-334e3444dd92" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Deleting offline snapshot 3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 of volume 2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] snapshot_file for this snap is: volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[baca84f2-42f2-4974-9155-6282c141bc6d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:34 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 Nov 06 21:44:34 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:34 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 1G" returned: 0 in 0.513s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:34 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 Nov 06 21:44:34 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:34 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92" returned: 0 in 0.439s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ce27a3-8e01-4f68-9777-6b3b5d304fdf]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:35 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1" returned: 0 in 0.347s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:35 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 is being set with open permissions: ugo+rw Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:35 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 Nov 06 21:44:35 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:35 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 Nov 06 21:44:35 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:35 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1" returned: 0 in 0.247s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:35 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" returned: 0 in 0.364s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:35 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 Nov 06 21:44:35 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:35 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.info Nov 06 21:44:35 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:35 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.info" returned: 0 in 0.253s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:35 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.info is being set with open permissions: ugo+rw Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:35 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.info Nov 06 21:44:35 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:35 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:35 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92 Nov 06 21:44:35 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:35 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.info" returned: 0 in 0.266s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-16934224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=606dc429-53a1-418a-a4fa-8a5d0e1677c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ae466a6cb24c6b901523eae28960bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:34Z,use_quota=True,user_id='1f10527616ea4f75be9ddb76ba171784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Creating volume 606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:44:35 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:44:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:35 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 1073741824 Nov 06 21:44:35 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:35 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-656933c8-55b0-43b4-a171-09903fcbfd34 tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Create snapshot completed successfully Nov 06 21:44:36 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80.3e0c18f4-5b5c-49ad-b1e5-334e3444dd92" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-3e0c18f4-5b5c-49ad-b1e5-334e3444dd92" released by "_delete_snapshot" :: held 1.664s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" released by "delete_snapshot" :: held 1.691s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:36 devstack cinder-volume[87069]: WARNING cinder.quota [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-163557644 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-163557644, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:44:36 devstack cinder-volume[87069]: WARNING cinder.quota [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-163557644 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-163557644, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] Created reservations ['87e581cf-cc28-4df5-96e5-3715654299a4', '9f4ce96b-75fe-4f8c-8ada-44ad45115383', '59a217a9-6b5e-4a22-8791-02f588e95941', '619764cd-a183-4c15-b064-18d0ec247599'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:36 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5ca279ec-a938-4fc8-a4f6-4a38a09b52bf tempest-GroupSnapshotsTest-19394807 None] group_snapshot 5835158b-d147-4d19-b2e6-e2b6ceb16c75: deleted successfully Nov 06 21:44:36 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 1073741824" returned: 0 in 0.514s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:36 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 Nov 06 21:44:36 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:36 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6" returned: 0 in 0.312s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fa9362-1775-4ee8-8bb6-873dc201911d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9e866f-883c-4a76-bbcb-f7895921a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:36 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 (606dc429-53a1-418a-a4fa-8a5d0e1677c6): created successfully Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a9e866f-883c-4a76-bbcb-f7895921a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (bc636bd8-4c6e-48e3-9ded-cfb9459689c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:36 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-356b42c7-5c67-4e30-abaf-b75608393f13 tempest-VolumesSnapshotTestJSON-1136938097 None] Created volume successfully. Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "cinder-quobyte-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59a24a1-6eed-4e74-94ac-e3eb12ce9976]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:37 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 Nov 06 21:44:37 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Creating offline snapshot 8eb705cf-3976-4239-bc38-38f54d8796d4 of volume 606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bb7027-c668-4639-967f-2fea7fea9321]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "cinder-d4ea1b13-bacb-410a-a25a-e980cea0d7a1-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-d4ea1b13-bacb-410a-a25a-e980cea0d7a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "cinder-quobyte-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-quobyte-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "cinder-quobyte-d4ea1b13-bacb-410a-a25a-e980cea0d7a1" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-quobyte-d4ea1b13-bacb-410a-a25a-e980cea0d7a1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Deleting offline snapshot d4ea1b13-bacb-410a-a25a-e980cea0d7a1 of volume eb5fdc3f-7f0c-4f16-b509-f00589f69d6f {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] snapshot_file for this snap is: volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:37 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 Nov 06 21:44:37 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f16c35-b31c-4c35-8207-aad1e9520c9d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:37 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" returned: 0 in 0.483s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:37 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80 Nov 06 21:44:37 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:37 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 Nov 06 21:44:37 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:37 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6" returned: 0 in 0.448s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:37 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 1G Nov 06 21:44:37 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:38 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" returned: 0 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:38 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1" returned: 0 in 0.468s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Lock "cinder-quobyte-2d98d1c2-d9b8-4fb5-9e9c-93a356ff3d80" released by "delete_volume" :: held 0.974s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[590cf709-e18d-4b95-92de-0e1dcdeb829f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Created reservations ['388c5ad4-6a56-40b2-aa0d-cb72ab2f2c68'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:38 devstack cinder-volume[87069]: WARNING cinder.quota [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-163557644 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-163557644, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Created reservations ['51cc08c0-dd8a-4be0-a0e8-b24d9821f185', '0edac34c-6732-44b2-af97-9118f9a7792b', 'abd91697-2140-4a5a-a637-f23a6d950e5e', '48e0f075-9156-4b0f-9f62-282302e394ff'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:38 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f Nov 06 21:44:38 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:38 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:38 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:38 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 1G" returned: 0 in 0.596s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:38 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 Nov 06 21:44:38 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:38 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" returned: 0 in 0.467s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:38 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 Nov 06 21:44:38 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:38 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.336s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8a5a0ee4-5eef-47cf-b336-ef6ed63be1d1 tempest-GroupSnapshotsTest-19394807 None] Delete group completed successfully. Nov 06 21:44:38 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4" returned: 0 in 0.384s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:38 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 is being set with open permissions: ugo+rw Nov 06 21:44:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:38 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 Nov 06 21:44:38 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:39 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1" returned: 0 in 0.515s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:39 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1 Nov 06 21:44:39 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:39 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4" returned: 0 in 0.294s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:39 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.info Nov 06 21:44:39 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:39 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f.d4ea1b13-bacb-410a-a25a-e980cea0d7a1" returned: 0 in 0.310s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-quobyte-d4ea1b13-bacb-410a-a25a-e980cea0d7a1" released by "_delete_snapshot" :: held 1.922s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-quobyte-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" released by "delete_snapshot" :: held 1.946s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:39 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.info" returned: 0 in 0.322s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:39 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.info is being set with open permissions: ugo+rw Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Created reservations ['fe8e493b-1756-47f0-8fd7-0872d2ee0584', '88471285-dc76-43a4-9817-5270e6d1cf92', '5b69ed48-b159-4201-ab8b-cdd1c5af574a', 'aea857e3-d57f-402c-9a25-2462973f241c'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:39 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.info Nov 06 21:44:39 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:39 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Delete snapshot completed successfully. Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29ae5909-964c-44a1-bb69-a9ae39c3c82c tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-d4ea1b13-bacb-410a-a25a-e980cea0d7a1-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:39 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.info" returned: 0 in 0.290s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.466s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:39 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-434d8945-2fa0-40c8-bc09-089e2afa2420 tempest-VolumesSnapshotTestJSON-1136938097 None] Create snapshot completed successfully Nov 06 21:44:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "cinder-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "cinder-quobyte-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-quobyte-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c665d-07fc-417c-8b9b-2531878306c9]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:41 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f Nov 06 21:44:41 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (870130a3-b2e1-4008-a880-fe0f780bd772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e47f94a-8b8c-47bf-b4c5-6340de8411eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e47f94a-8b8c-47bf-b4c5-6340de8411eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1151501520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f493d421-e3e0-4a43-b075-216a9d606797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ae466a6cb24c6b901523eae28960bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8eb705cf-3976-4239-bc38-38f54d8796d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:41Z,use_quota=True,user_id='1f10527616ea4f75be9ddb76ba171784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81ad581-4dce-4321-b75d-637c8be19ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81ad581-4dce-4321-b75d-637c8be19ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f77d7d-aa3b-4a42-8c5b-074fbb36b732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f77d7d-aa3b-4a42-8c5b-074fbb36b732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f493d421-e3e0-4a43-b075-216a9d606797', 'volume_name': 'volume-f493d421-e3e0-4a43-b075-216a9d606797', 'volume_size': 2, 'snapshot_id': '8eb705cf-3976-4239-bc38-38f54d8796d4'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171edaa3-d54a-4414-b0b2-c6d85923c1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171edaa3-d54a-4414-b0b2-c6d85923c1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383f813f-67a5-4477-852b-10ce2d5c0d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:41 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume f493d421-e3e0-4a43-b075-216a9d606797: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f493d421-e3e0-4a43-b075-216a9d606797', 'volume_size': 2, 'snapshot_id': '8eb705cf-3976-4239-bc38-38f54d8796d4'} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-8eb705cf-3976-4239-bc38-38f54d8796d4-f493d421-e3e0-4a43-b075-216a9d606797" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-8eb705cf-3976-4239-bc38-38f54d8796d4-f493d421-e3e0-4a43-b075-216a9d606797" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Creating volume f493d421-e3e0-4a43-b075-216a9d606797 from snapshot 8eb705cf-3976-4239-bc38-38f54d8796d4 {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-f493d421-e3e0-4a43-b075-216a9d606797" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f493d421-e3e0-4a43-b075-216a9d606797" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] snapshot: 8eb705cf-3976-4239-bc38-38f54d8796d4, volume: f493d421-e3e0-4a43-b075-216a9d606797, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af749a9-81ae-41f5-bc97-22a7b9a41f4b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:41 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" returned: 0 in 0.595s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:41 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f Nov 06 21:44:41 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:41 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 Nov 06 21:44:41 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:41 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" returned: 0 in 0.330s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-quobyte-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f" released by "delete_volume" :: held 1.058s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:42 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4" returned: 0 in 0.478s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b1563b-bdba-4217-b9b3-fbec52d20f27]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Created reservations ['ceeed227-a79e-420f-a88e-f00f385b7020', 'dac2bf0a-d1aa-410f-87ef-348c879b191d', '690bf546-35e0-4fe4-bc45-abebf5fd8483', '58c1b785-9d5f-41e1-82a9-33247ea8f4a9'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:42 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 Nov 06 21:44:42 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:42 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:42 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:42 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6" returned: 0 in 0.547s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:42 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.337s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:42 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Deleted volume successfully. Nov 06 21:44:42 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 Nov 06 21:44:42 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fdc228d7-b09f-4329-9261-85c0724f6d2f tempest-VolumeSnapshotQuotasNegativeTestJSON-476856703 None] Lock "cinder-eb5fdc3f-7f0c-4f16-b509-f00589f69d6f-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e6c801ea-f557-4b41-833b-073e735adbcd tempest-GroupsTest-301887949 None] Group tempest-Group1-1950363350: creating Nov 06 21:44:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e6c801ea-f557-4b41-833b-073e735adbcd tempest-GroupsTest-301887949 None] Group tempest-Group1-1950363350: created successfully Nov 06 21:44:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e6c801ea-f557-4b41-833b-073e735adbcd tempest-GroupsTest-301887949 None] Create group completed successfully. Nov 06 21:44:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-075b8716-7f71-4429-83a1-a53bcfc6a17c tempest-GroupsTest-301887949 None] Group tempest-Group2-1728584778: creating Nov 06 21:44:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-075b8716-7f71-4429-83a1-a53bcfc6a17c tempest-GroupsTest-301887949 None] Group tempest-Group2-1728584778: created successfully Nov 06 21:44:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-075b8716-7f71-4429-83a1-a53bcfc6a17c tempest-GroupsTest-301887949 None] Create group completed successfully. Nov 06 21:44:51 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797" returned: 0 in 9.133s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:51 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6, size 1024.00 MB, duration 9.13 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:44:51 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Converted 1024.00 MB image at 112.11 MB/s Nov 06 21:44:51 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 is being set with open permissions: ugo+rw Nov 06 21:44:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:51 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 Nov 06 21:44:51 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:52 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797" returned: 0 in 0.312s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f493d421-e3e0-4a43-b075-216a9d606797" released by "_copy_volume_from_snapshot" :: held 10.596s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-8eb705cf-3976-4239-bc38-38f54d8796d4-f493d421-e3e0-4a43-b075-216a9d606797" released by "_create_volume_from_snapshot" :: held 10.721s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.747s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383f813f-67a5-4477-852b-10ce2d5c0d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f493d421-e3e0-4a43-b075-216a9d606797', 'volume_size': 2, 'snapshot_id': '8eb705cf-3976-4239-bc38-38f54d8796d4'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65be082-aef8-44e2-bd99-1005cb1ba502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:52 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Volume volume-f493d421-e3e0-4a43-b075-216a9d606797 (f493d421-e3e0-4a43-b075-216a9d606797): created successfully Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65be082-aef8-44e2-bd99-1005cb1ba502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (870130a3-b2e1-4008-a880-fe0f780bd772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Flow 'volume_create_manager' (5c74b74b-eeb4-4111-b916-1c291da4e529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5200a2-f5cd-470c-a976-d91287f20e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-81afe8ea-9ffc-4ad1-8ef2-82e268be4a20 tempest-VolumesSnapshotTestJSON-1136938097 None] Created volume successfully. Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e5200a2-f5cd-470c-a976-d91287f20e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986201783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19f4d2dd-062d-4288-9906-a53bfa4822c4,host='devstack@QuobyteHD#QuobyteHD',id=06f31a3b-0051-4ff3-96a3-54ea9ee871b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23fc129e9fb4bcd9fe15865dd651e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:52Z,use_quota=True,user_id='b23f2ec8721c4c8da43747705324b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b6b9bc8-91d9-47e0-962a-af450a2b760c),volume_type_id=8b6b9bc8-91d9-47e0-962a-af450a2b760c)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f42ecae-b110-4bb3-a97d-bf3eb4e96bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f42ecae-b110-4bb3-a97d-bf3eb4e96bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bf2c55-4fa3-4a6e-a2a8-726dd7ce6d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3bf2c55-4fa3-4a6e-a2a8-726dd7ce6d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f31a3b-0051-4ff3-96a3-54ea9ee871b9', 'volume_name': 'volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de37a878-a821-4258-91f1-f1c33dab195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de37a878-a821-4258-91f1-f1c33dab195b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e88a7ea-23e1-46ae-88b2-26f81410ca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:52 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Volume 06f31a3b-0051-4ff3-96a3-54ea9ee871b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9', 'volume_size': 1} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19f4d2dd-062d-4288-9906-a53bfa4822c4,created_at=2026-11-06T20:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986201783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19f4d2dd-062d-4288-9906-a53bfa4822c4,host='devstack@QuobyteHD#QuobyteHD',id=06f31a3b-0051-4ff3-96a3-54ea9ee871b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23fc129e9fb4bcd9fe15865dd651e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:44:52Z,use_quota=True,user_id='b23f2ec8721c4c8da43747705324b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b6b9bc8-91d9-47e0-962a-af450a2b760c),volume_type_id=8b6b9bc8-91d9-47e0-962a-af450a2b760c)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Creating volume 06f31a3b-0051-4ff3-96a3-54ea9ee871b9 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:44:52 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:52 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 1073741824 Nov 06 21:44:52 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-f493d421-e3e0-4a43-b075-216a9d606797-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-f493d421-e3e0-4a43-b075-216a9d606797-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-f493d421-e3e0-4a43-b075-216a9d606797" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f493d421-e3e0-4a43-b075-216a9d606797" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e2fdd4-12db-49e6-b601-5b275b6253a5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:53 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 Nov 06 21:44:53 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:53 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 1073741824" returned: 0 in 0.636s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:53 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 Nov 06 21:44:53 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:53 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797" returned: 0 in 0.443s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:53 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797 Nov 06 21:44:53 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:53 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9" returned: 0 in 0.340s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e88a7ea-23e1-46ae-88b2-26f81410ca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eee914f-0f25-4f94-8453-9ccccae57737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Volume volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 (06f31a3b-0051-4ff3-96a3-54ea9ee871b9): created successfully Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eee914f-0f25-4f94-8453-9ccccae57737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Flow 'volume_create_manager' (5c74b74b-eeb4-4111-b916-1c291da4e529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-867a9540-cb64-45b4-a8c1-986f7fbbf4c9 tempest-GroupsTest-301887949 None] Created volume successfully. Nov 06 21:44:53 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f493d421-e3e0-4a43-b075-216a9d606797" returned: 0 in 0.373s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f493d421-e3e0-4a43-b075-216a9d606797" released by "delete_volume" :: held 0.863s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Created reservations ['2a787abe-0301-4ff7-84fe-85675c134a92', 'a64fe45e-07fe-4b8e-99d6-b8a1d58d3388', '5d8fa2da-2490-417c-9220-cf88df60a188', 'e20f79c8-6522-4992-b965-7332acf8b137'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:53 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:53 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-8eb705cf-3976-4239-bc38-38f54d8796d4-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-8eb705cf-3976-4239-bc38-38f54d8796d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-606dc429-53a1-418a-a4fa-8a5d0e1677c6" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-606dc429-53a1-418a-a4fa-8a5d0e1677c6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-8eb705cf-3976-4239-bc38-38f54d8796d4" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-8eb705cf-3976-4239-bc38-38f54d8796d4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Deleting offline snapshot 8eb705cf-3976-4239-bc38-38f54d8796d4 of volume 606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] snapshot_file for this snap is: volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaf699d-40db-410c-a04f-60e718b5a7cf]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:54 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.324s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Deleted volume successfully. Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-54ab7a5c-17ae-43ba-bd0e-b76370f7b262 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-f493d421-e3e0-4a43-b075-216a9d606797-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:54 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 Nov 06 21:44:54 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:54 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4" returned: 0 in 0.406s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac7c685-d1e5-4586-9c43-9eac814e22ce]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:54 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 Nov 06 21:44:54 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:55 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6" returned: 0 in 0.682s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:55 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 Nov 06 21:44:55 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:55 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4" returned: 0 in 0.498s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:55 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4 Nov 06 21:44:55 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Acquiring lock "cinder-quobyte-06f31a3b-0051-4ff3-96a3-54ea9ee871b9" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Lock "cinder-quobyte-06f31a3b-0051-4ff3-96a3-54ea9ee871b9" acquired by "delete_volume" :: waited 0.035s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:55 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c126e1a-b3d2-4ce3-bb05-af393f18c8bb]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:56 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 Nov 06 21:44:56 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:56 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6.8eb705cf-3976-4239-bc38-38f54d8796d4" returned: 0 in 0.471s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-8eb705cf-3976-4239-bc38-38f54d8796d4" released by "_delete_snapshot" :: held 2.206s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-606dc429-53a1-418a-a4fa-8a5d0e1677c6" released by "delete_snapshot" :: held 2.249s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:56 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9" returned: 0 in 0.438s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Created reservations ['7e999180-5d95-41a7-9d02-9dc53cec4a72', '4a9c514c-24b3-47d5-b9b6-f9b0fc6247ae', 'ca266387-9615-4bae-b9a8-944e862b9f45', 'a06e1fc9-acb9-4076-b79a-9fd0fed7d586'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:56 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9 Nov 06 21:44:56 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Delete snapshot completed successfully. Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6507ce82-3af4-4593-a615-f74a25f538d3 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-8eb705cf-3976-4239-bc38-38f54d8796d4-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:56 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-06f31a3b-0051-4ff3-96a3-54ea9ee871b9" returned: 0 in 0.293s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Lock "cinder-quobyte-06f31a3b-0051-4ff3-96a3-54ea9ee871b9" released by "delete_volume" :: held 0.815s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Created reservations ['f1d7875d-74b6-43dc-8f34-63cb71b855e2'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:56 devstack cinder-volume[87069]: WARNING cinder.quota [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1168121337 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1168121337, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:44:56 devstack cinder-volume[87069]: WARNING cinder.quota [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1168121337 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1168121337, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:44:56 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Created reservations ['80c5ed52-be04-413b-94fe-fdf15a643805', '0a10572d-9e5a-466d-8b7c-e18167751db1', 'd3a6754b-604e-42dc-b72a-c5af5e1f11ce', '527f7f42-dd63-4fc6-ba94-5723a12068bc'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:57 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:57 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Created reservations ['bb988148-7e39-4a8c-9c85-7d945b182650'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:57 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.390s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:57 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f0c22c0e-e458-4c6a-8895-54a5cb740e15 tempest-GroupsTest-301887949 None] Delete group completed successfully. Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:57 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:57 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-606dc429-53a1-418a-a4fa-8a5d0e1677c6-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-606dc429-53a1-418a-a4fa-8a5d0e1677c6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-606dc429-53a1-418a-a4fa-8a5d0e1677c6" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-606dc429-53a1-418a-a4fa-8a5d0e1677c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae18f8b6-54d4-4e47-bc1e-adb65259acc5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:57 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 Nov 06 21:44:57 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:57 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.409s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:57 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:57 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b47c6750-0691-4fd6-a11e-ec733739f90e tempest-GroupsTest-301887949 None] Delete group completed successfully. Nov 06 21:44:58 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6" returned: 0 in 0.490s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:58 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6 Nov 06 21:44:58 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:58 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-606dc429-53a1-418a-a4fa-8a5d0e1677c6" returned: 0 in 0.339s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-606dc429-53a1-418a-a4fa-8a5d0e1677c6" released by "delete_volume" :: held 0.932s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Created reservations ['171d8466-a9e9-486b-8c14-278199480438', '4ef8f937-f7d4-475e-b57a-3bff7fb52127', '95a7d347-5689-496a-a576-dec742671a17', 'b3288e24-10ee-4090-9664-e69ed9432791'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:58 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:58 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:58 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:44:58 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:44:59 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.511s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:59 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Deleted volume successfully. Nov 06 21:44:59 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.535s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a92dc33c-74fd-4372-88cb-f1e140dc9b9b tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-606dc429-53a1-418a-a4fa-8a5d0e1677c6-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:44:59 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1e229590-79d4-4be5-99bd-2e7d44d1bcce tempest-GroupsTest-301887949 None] Group tempest-GroupsTest-Group-1601849224: creating Nov 06 21:44:59 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1e229590-79d4-4be5-99bd-2e7d44d1bcce tempest-GroupsTest-301887949 None] Group tempest-GroupsTest-Group-1601849224: created successfully Nov 06 21:44:59 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1e229590-79d4-4be5-99bd-2e7d44d1bcce tempest-GroupsTest-301887949 None] Create group completed successfully. Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (2f80b0ae-0b50-423a-81e0-6550ca79f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09732dba-a83e-46f6-966f-83427e1025e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09732dba-a83e-46f6-966f-83427e1025e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-130102038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f700d60a-45c3-4553-b09f-747fd4cda96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ae466a6cb24c6b901523eae28960bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:00Z,use_quota=True,user_id='1f10527616ea4f75be9ddb76ba171784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034c0313-72f4-42fd-b8da-f3eeb42da874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034c0313-72f4-42fd-b8da-f3eeb42da874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb87312e-1c76-4c03-b200-fb5d6e8f84ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb87312e-1c76-4c03-b200-fb5d6e8f84ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f700d60a-45c3-4553-b09f-747fd4cda96a', 'volume_name': 'volume-f700d60a-45c3-4553-b09f-747fd4cda96a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73822504-f3e4-4306-9703-65d3babb815f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73822504-f3e4-4306-9703-65d3babb815f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1a1956-5358-4644-ab3f-666c417da93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:44:59 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Volume f700d60a-45c3-4553-b09f-747fd4cda96a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f700d60a-45c3-4553-b09f-747fd4cda96a', 'volume_size': 1} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-130102038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f700d60a-45c3-4553-b09f-747fd4cda96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ae466a6cb24c6b901523eae28960bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:00Z,use_quota=True,user_id='1f10527616ea4f75be9ddb76ba171784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Creating volume f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:44:59 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:44:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:44:59 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a 1073741824 Nov 06 21:44:59 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:00 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a 1073741824" returned: 0 in 0.524s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:00 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a Nov 06 21:45:00 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:00 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a" returned: 0 in 0.332s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1a1956-5358-4644-ab3f-666c417da93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f700d60a-45c3-4553-b09f-747fd4cda96a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e76876-00ac-4887-bbb1-b3c3964601f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:00 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Volume volume-f700d60a-45c3-4553-b09f-747fd4cda96a (f700d60a-45c3-4553-b09f-747fd4cda96a): created successfully Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79e76876-00ac-4887-bbb1-b3c3964601f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (2f80b0ae-0b50-423a-81e0-6550ca79f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:00 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e63f8a7d-bad8-42c7-b3e8-8bb6a2ce2f6d tempest-VolumesSnapshotTestJSON-1136938097 None] Created volume successfully. Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Flow 'volume_create_manager' (0de3f42d-115b-46d8-ab48-b2df409ef5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d33cef-e9d5-4841-bc45-f9a3653da765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d33cef-e9d5-4841-bc45-f9a3653da765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876791305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5634cf4-d794-43fa-9891-0c17d941ea7e,host='devstack@QuobyteHD#QuobyteHD',id=21fec2d3-78f7-4f22-8ef5-d7ca26765056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23fc129e9fb4bcd9fe15865dd651e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:01Z,use_quota=True,user_id='b23f2ec8721c4c8da43747705324b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce0d934-cf9e-407e-a2df-e9a1a1ef60a5),volume_type_id=4ce0d934-cf9e-407e-a2df-e9a1a1ef60a5)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7714331-5654-4cd7-899a-2ce8e46f6458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7714331-5654-4cd7-899a-2ce8e46f6458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0027b14b-2a11-49f7-84c6-a7fd2cd441ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0027b14b-2a11-49f7-84c6-a7fd2cd441ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21fec2d3-78f7-4f22-8ef5-d7ca26765056', 'volume_name': 'volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1534b5ef-5b15-4ad5-b1ef-653bf9e66f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1534b5ef-5b15-4ad5-b1ef-653bf9e66f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf228b68-f7f1-48c5-b56a-c79873b2c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:01 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Volume 21fec2d3-78f7-4f22-8ef5-d7ca26765056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056', 'volume_size': 1} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5634cf4-d794-43fa-9891-0c17d941ea7e,created_at=2026-11-06T20:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876791305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5634cf4-d794-43fa-9891-0c17d941ea7e,host='devstack@QuobyteHD#QuobyteHD',id=21fec2d3-78f7-4f22-8ef5-d7ca26765056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23fc129e9fb4bcd9fe15865dd651e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:01Z,use_quota=True,user_id='b23f2ec8721c4c8da43747705324b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce0d934-cf9e-407e-a2df-e9a1a1ef60a5),volume_type_id=4ce0d934-cf9e-407e-a2df-e9a1a1ef60a5)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Creating volume 21fec2d3-78f7-4f22-8ef5-d7ca26765056 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:45:01 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:01 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 1073741824 Nov 06 21:45:01 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:01 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 1073741824" returned: 0 in 0.516s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:01 devstack sudo[95821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 Nov 06 21:45:01 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:02 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056" returned: 0 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.075s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Creating offline snapshot fe90eebd-bbf8-4fb9-b631-42fb3185fcce of volume f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf228b68-f7f1-48c5-b56a-c79873b2c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36295dd8-0a2d-4488-86a4-ebb97e4011b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f1592-47ba-471b-9963-2e6abd72d7b5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Volume volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 (21fec2d3-78f7-4f22-8ef5-d7ca26765056): created successfully Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36295dd8-0a2d-4488-86a4-ebb97e4011b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Flow 'volume_create_manager' (0de3f42d-115b-46d8-ab48-b2df409ef5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1b7d90e7-00b8-4eae-9df1-c501b19764ea tempest-GroupsTest-301887949 None] Created volume successfully. Nov 06 21:45:02 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a Nov 06 21:45:02 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:45:02 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Flow 'volume_create_manager' (8493d946-b6dd-46e8-9d4d-89f4085ad873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4271c29e-ce80-421b-b016-f721e826e2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a" returned: 0 in 0.512s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4271c29e-ce80-421b-b016-f721e826e2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-968423451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fd6cee-d11c-4574-8e3d-243dc422f018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0c8ccb65264263be89cb9dcd8072be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:03Z,use_quota=True,user_id='3a00edc17aef4d6ba781bd10ad407cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:02 devstack sudo[95830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce 1G Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b476ced3-37d3-44e3-bc28-ccdf1a125609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:02 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b476ced3-37d3-44e3-bc28-ccdf1a125609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4692ebb0-f2a9-46a1-9784-f9b02b587389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4692ebb0-f2a9-46a1-9784-f9b02b587389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71fd6cee-d11c-4574-8e3d-243dc422f018', 'volume_name': 'volume-71fd6cee-d11c-4574-8e3d-243dc422f018', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e699801e-6b38-494f-97ef-e94d78947107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e699801e-6b38-494f-97ef-e94d78947107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f82714b-2023-4310-aaf8-90ef98113995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Volume 71fd6cee-d11c-4574-8e3d-243dc422f018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71fd6cee-d11c-4574-8e3d-243dc422f018', 'volume_size': 1} Nov 06 21:45:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:03 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce 1G" returned: 0 in 0.495s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f700d60a-45c3-4553-b09f-747fd4cda96a -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:03 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f700d60a-45c3-4553-b09f-747fd4cda96a -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce Nov 06 21:45:03 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:03 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f700d60a-45c3-4553-b09f-747fd4cda96a -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce" returned: 0 in 0.377s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:03 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce is being set with open permissions: ugo+rw Nov 06 21:45:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:03 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce Nov 06 21:45:03 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:03 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce" returned: 0 in 0.289s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:03 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.info Nov 06 21:45:03 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:45:04 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Flow 'volume_create_manager' (d86901f7-9b12-4da6-98e1-fd5a2289a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7be6089-12ad-400a-8a74-ddc63c5fc4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.info" returned: 0 in 0.416s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:04 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.info is being set with open permissions: ugo+rw Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7be6089-12ad-400a-8a74-ddc63c5fc4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-478578937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5634cf4-d794-43fa-9891-0c17d941ea7e,host='devstack@QuobyteHD#QuobyteHD',id=7778301d-fe7c-4ee7-b293-8b36490e6fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23fc129e9fb4bcd9fe15865dd651e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:04Z,use_quota=True,user_id='b23f2ec8721c4c8da43747705324b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce0d934-cf9e-407e-a2df-e9a1a1ef60a5),volume_type_id=4ce0d934-cf9e-407e-a2df-e9a1a1ef60a5)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:04 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.info Nov 06 21:45:04 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b95b1c-b868-4323-8e5c-43083925e701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b95b1c-b868-4323-8e5c-43083925e701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29256f4f-a830-4fe5-9b64-d44483849745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29256f4f-a830-4fe5-9b64-d44483849745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7778301d-fe7c-4ee7-b293-8b36490e6fc7', 'volume_name': 'volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb28c04-6310-4591-babf-1a71fd901410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb28c04-6310-4591-babf-1a71fd901410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b90cc25-f7d6-425b-9c14-811d0ba4e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:04 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Volume 7778301d-fe7c-4ee7-b293-8b36490e6fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7', 'volume_size': 1} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:04 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.info" returned: 0 in 0.303s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.902s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-968423451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fd6cee-d11c-4574-8e3d-243dc422f018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0c8ccb65264263be89cb9dcd8072be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:03Z,use_quota=True,user_id='3a00edc17aef4d6ba781bd10ad407cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Creating volume 71fd6cee-d11c-4574-8e3d-243dc422f018 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:45:04 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:45:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:04 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 1073741824 Nov 06 21:45:04 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0f204efe-6ac7-479b-93ea-a2b10ca07f80 tempest-VolumesSnapshotTestJSON-1136938097 None] Create snapshot completed successfully Nov 06 21:45:05 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 1073741824" returned: 0 in 0.574s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:05 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 Nov 06 21:45:05 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:05 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018" returned: 0 in 0.272s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5634cf4-d794-43fa-9891-0c17d941ea7e,created_at=2026-11-06T20:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-478578937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5634cf4-d794-43fa-9891-0c17d941ea7e,host='devstack@QuobyteHD#QuobyteHD',id=7778301d-fe7c-4ee7-b293-8b36490e6fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23fc129e9fb4bcd9fe15865dd651e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:04Z,use_quota=True,user_id='b23f2ec8721c4c8da43747705324b585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce0d934-cf9e-407e-a2df-e9a1a1ef60a5),volume_type_id=4ce0d934-cf9e-407e-a2df-e9a1a1ef60a5)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Creating volume 7778301d-fe7c-4ee7-b293-8b36490e6fc7 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:45:05 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f82714b-2023-4310-aaf8-90ef98113995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71fd6cee-d11c-4574-8e3d-243dc422f018', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce902178-e575-44a5-8cc9-00e67a6527e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:05 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 1073741824 Nov 06 21:45:05 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:05 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Volume volume-71fd6cee-d11c-4574-8e3d-243dc422f018 (71fd6cee-d11c-4574-8e3d-243dc422f018): created successfully Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce902178-e575-44a5-8cc9-00e67a6527e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Flow 'volume_create_manager' (8493d946-b6dd-46e8-9d4d-89f4085ad873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:05 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e0ff27a6-178f-4d23-ab18-4349f7dcfcfb tempest-SnapshotMetadataTestJSON-1731305021 None] Created volume successfully. Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (cc9342ca-91e4-4ea6-9970-ac0773f0f093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8206f441-3243-4611-b653-bb4ae24f9133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8206f441-3243-4611-b653-bb4ae24f9133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-430631523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa7e758-5122-4015-ad0a-20d78c549a88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09ae466a6cb24c6b901523eae28960bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe90eebd-bbf8-4fb9-b631-42fb3185fcce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:06Z,use_quota=True,user_id='1f10527616ea4f75be9ddb76ba171784',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f64deb-fdce-41a4-8179-3f135d2e1246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f64deb-fdce-41a4-8179-3f135d2e1246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d66387-f39e-4748-8d8b-46838c3b3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d66387-f39e-4748-8d8b-46838c3b3e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1aa7e758-5122-4015-ad0a-20d78c549a88', 'volume_name': 'volume-1aa7e758-5122-4015-ad0a-20d78c549a88', 'volume_size': 1, 'snapshot_id': 'fe90eebd-bbf8-4fb9-b631-42fb3185fcce'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0451c5a0-09ff-4597-9ca1-c97105482ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0451c5a0-09ff-4597-9ca1-c97105482ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d96abd7-9205-47d6-b076-965875056a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:06 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Volume 1aa7e758-5122-4015-ad0a-20d78c549a88: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1aa7e758-5122-4015-ad0a-20d78c549a88', 'volume_size': 1, 'snapshot_id': 'fe90eebd-bbf8-4fb9-b631-42fb3185fcce'} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:06 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 1073741824" returned: 0 in 0.613s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=176,cinder:UPDATE=189,cinder:INSERT=49,cinder:DELETE=8 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:06 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 Nov 06 21:45:06 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:06 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7" returned: 0 in 0.271s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.487s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-fe90eebd-bbf8-4fb9-b631-42fb3185fcce-1aa7e758-5122-4015-ad0a-20d78c549a88" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=190,cinder:INSERT=48,cinder:UPDATE=191,cinder:DELETE=12 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b90cc25-f7d6-425b-9c14-811d0ba4e629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510c251c-8eed-4fc1-a21a-27a2e18940e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-fe90eebd-bbf8-4fb9-b631-42fb3185fcce-1aa7e758-5122-4015-ad0a-20d78c549a88" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Creating volume 1aa7e758-5122-4015-ad0a-20d78c549a88 from snapshot fe90eebd-bbf8-4fb9-b631-42fb3185fcce {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-1aa7e758-5122-4015-ad0a-20d78c549a88" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:06 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Volume volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 (7778301d-fe7c-4ee7-b293-8b36490e6fc7): created successfully Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510c251c-8eed-4fc1-a21a-27a2e18940e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Flow 'volume_create_manager' (d86901f7-9b12-4da6-98e1-fd5a2289a085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-1aa7e758-5122-4015-ad0a-20d78c549a88" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] snapshot: fe90eebd-bbf8-4fb9-b631-42fb3185fcce, volume: 1aa7e758-5122-4015-ad0a-20d78c549a88, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:45:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5b2f99d9-901f-4dc5-9994-86a7d30a76ef tempest-GroupsTest-301887949 None] Created volume successfully. Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[282ec83e-1837-4a5c-b7f1-5b2ed915cfc5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:06 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce Nov 06 21:45:06 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:07 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce" returned: 0 in 0.547s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f700d60a-45c3-4553-b09f-747fd4cda96a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f2bff-2d81-455b-bd57-da0a98cdcc90]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:07 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a Nov 06 21:45:07 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:07 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a" returned: 0 in 0.639s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:45:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:08 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 Nov 06 21:45:08 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-3d13cabc-1089-4690-b3ea-a7465e4bccbe tempest-GroupsTest-301887949 None] Update group completed successfully. Nov 06 21:45:10 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0e3722e4-5c2b-47f3-98e2-391667da4df4 tempest-GroupsTest-301887949 None] Update group completed successfully. Nov 06 21:45:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Acquiring lock "cinder-quobyte-21fec2d3-78f7-4f22-8ef5-d7ca26765056" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Lock "cinder-quobyte-21fec2d3-78f7-4f22-8ef5-d7ca26765056" acquired by "delete_volume" :: waited 0.045s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:12 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abae90b-e444-4ed0-b6ff-9bcc7d516b73]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:13 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 Nov 06 21:45:13 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:13 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056" returned: 0 in 1.101s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:13 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056 Nov 06 21:45:13 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:14 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-21fec2d3-78f7-4f22-8ef5-d7ca26765056" returned: 0 in 0.616s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Lock "cinder-quobyte-21fec2d3-78f7-4f22-8ef5-d7ca26765056" released by "delete_volume" :: held 1.857s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Acquiring lock "cinder-quobyte-7778301d-fe7c-4ee7-b293-8b36490e6fc7" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Lock "cinder-quobyte-7778301d-fe7c-4ee7-b293-8b36490e6fc7" acquired by "delete_volume" :: waited 0.048s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfb5f63-86b1-4d6a-9992-6e670911413f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:14 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 Nov 06 21:45:14 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:15 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7" returned: 0 in 0.697s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:15 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7 Nov 06 21:45:15 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:15 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7778301d-fe7c-4ee7-b293-8b36490e6fc7" returned: 0 in 0.587s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Lock "cinder-quobyte-7778301d-fe7c-4ee7-b293-8b36490e6fc7" released by "delete_volume" :: held 1.409s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Created reservations ['aae47d85-83d7-425a-9827-4a29af59f225'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:16 devstack cinder-volume[87069]: WARNING cinder.quota [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1824321342 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1824321342, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:45:16 devstack cinder-volume[87069]: WARNING cinder.quota [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1824321342 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1824321342, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Created reservations ['1461f0f5-2653-4e53-a916-3e0b415682a6', '5205ca94-8877-46fb-be6d-f39d70802f93', 'f737a242-cb25-46e0-a11a-d5f9b6c50795', '88b1c118-de9d-4fad-8250-4c3341827b0a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Created reservations ['f1767ab8-4eb2-4ad9-9c40-d447d8b0a961', '3c844e61-f6ac-4f54-9947-8c9e3e61d133', 'fe802bc5-a018-40e3-a33d-4870d386571d', 'a871ea46-20a3-4225-9a61-03411e2b7f90'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:16 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:17 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:17 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.996s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:17 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:17 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-14b3f2cd-ca0e-49a3-987b-b50757904584 tempest-GroupsTest-301887949 None] Delete group completed successfully. Nov 06 21:45:18 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88" returned: 0 in 10.579s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a, size 1024.00 MB, duration 10.58 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:45:18 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Converted 1024.00 MB image at 96.79 MB/s Nov 06 21:45:18 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 is being set with open permissions: ugo+rw Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:18 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 Nov 06 21:45:18 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:18 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-1aa7e758-5122-4015-ad0a-20d78c549a88" released by "_copy_volume_from_snapshot" :: held 12.146s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-fe90eebd-bbf8-4fb9-b631-42fb3185fcce-1aa7e758-5122-4015-ad0a-20d78c549a88" released by "_create_volume_from_snapshot" :: held 12.248s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.300s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.677s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Creating offline snapshot 40728bbe-c06a-4117-a501-53923d2fed1a of volume 71fd6cee-d11c-4574-8e3d-243dc422f018 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d96abd7-9205-47d6-b076-965875056a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa7e758-5122-4015-ad0a-20d78c549a88', 'volume_size': 1, 'snapshot_id': 'fe90eebd-bbf8-4fb9-b631-42fb3185fcce'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9d02be-6bde-45b2-a6bd-7f4954b28c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8b5512-f7ac-4a61-818d-bb15a8ca252c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:18 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Volume volume-1aa7e758-5122-4015-ad0a-20d78c549a88 (1aa7e758-5122-4015-ad0a-20d78c549a88): created successfully Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad9d02be-6bde-45b2-a6bd-7f4954b28c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Flow 'volume_create_manager' (cc9342ca-91e4-4ea6-9970-ac0773f0f093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d4109f51-96c7-4265-9747-8a7381b9e90d tempest-VolumesSnapshotTestJSON-1136938097 None] Created volume successfully. Nov 06 21:45:19 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 Nov 06 21:45:19 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:19 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018" returned: 0 in 0.443s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:19 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a 1G Nov 06 21:45:19 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-1aa7e758-5122-4015-ad0a-20d78c549a88-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-1aa7e758-5122-4015-ad0a-20d78c549a88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-1aa7e758-5122-4015-ad0a-20d78c549a88" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-1aa7e758-5122-4015-ad0a-20d78c549a88" acquired by "delete_volume" :: waited 0.039s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:19 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a 1G" returned: 0 in 0.582s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fd6cee-d11c-4574-8e3d-243dc422f018 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c0d76-3efb-42b2-b35c-5aac099b444b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:19 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fd6cee-d11c-4574-8e3d-243dc422f018 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a Nov 06 21:45:19 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:20 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 Nov 06 21:45:20 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:20 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fd6cee-d11c-4574-8e3d-243dc422f018 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a" returned: 0 in 0.391s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:20 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a is being set with open permissions: ugo+rw Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:20 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a Nov 06 21:45:20 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:20 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88" returned: 0 in 0.534s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:20 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88 Nov 06 21:45:20 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:20 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a" returned: 0 in 0.267s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:20 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.info Nov 06 21:45:20 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:20 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1aa7e758-5122-4015-ad0a-20d78c549a88" returned: 0 in 0.341s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-1aa7e758-5122-4015-ad0a-20d78c549a88" released by "delete_volume" :: held 0.952s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:20 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.info" returned: 0 in 0.327s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:20 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.info is being set with open permissions: ugo+rw Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:20 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Created reservations ['c905fb8f-d49f-4956-b832-c35a8be51784', 'c66d5654-ad63-48ef-8f4f-9ba177ee635a', 'ea68f829-56e4-4b46-821d-f65523547294', '74d0fb54-bc56-458a-943e-40d5a94c2817'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:20 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.info Nov 06 21:45:20 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:21 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:21 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:21 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.info" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e52a8f95-8cab-46dc-aef6-1857f58fb84f tempest-SnapshotMetadataTestJSON-1731305021 None] Create snapshot completed successfully Nov 06 21:45:21 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.346s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Deleted volume successfully. Nov 06 21:45:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bc009e9d-c2c8-41a6-8e1e-aa7abb9556a0 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-1aa7e758-5122-4015-ad0a-20d78c549a88-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-fe90eebd-bbf8-4fb9-b631-42fb3185fcce-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-fe90eebd-bbf8-4fb9-b631-42fb3185fcce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-f700d60a-45c3-4553-b09f-747fd4cda96a" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f700d60a-45c3-4553-b09f-747fd4cda96a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-fe90eebd-bbf8-4fb9-b631-42fb3185fcce" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-fe90eebd-bbf8-4fb9-b631-42fb3185fcce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Deleting offline snapshot fe90eebd-bbf8-4fb9-b631-42fb3185fcce of volume f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] snapshot_file for this snap is: volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d43613-2500-4f2a-8c9e-cbbde996adb6]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:22 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce Nov 06 21:45:22 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:22 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce" returned: 0 in 0.396s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f700d60a-45c3-4553-b09f-747fd4cda96a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b1ec1b-5404-475b-aa6e-b519cd417b6a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:22 devstack sudo[96080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a Nov 06 21:45:22 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:23 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a" returned: 0 in 0.610s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:23 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce Nov 06 21:45:23 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "cinder-40728bbe-c06a-4117-a501-53923d2fed1a-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-40728bbe-c06a-4117-a501-53923d2fed1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "cinder-quobyte-71fd6cee-d11c-4574-8e3d-243dc422f018" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-quobyte-71fd6cee-d11c-4574-8e3d-243dc422f018" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "cinder-quobyte-40728bbe-c06a-4117-a501-53923d2fed1a" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-quobyte-40728bbe-c06a-4117-a501-53923d2fed1a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Deleting offline snapshot 40728bbe-c06a-4117-a501-53923d2fed1a of volume 71fd6cee-d11c-4574-8e3d-243dc422f018 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] snapshot_file for this snap is: volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[05785827-f957-45d7-8c71-106c25ce8d70]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:23 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a Nov 06 21:45:23 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:23 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce" returned: 0 in 0.367s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:23 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce Nov 06 21:45:23 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:23 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a" returned: 0 in 0.395s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71fd6cee-d11c-4574-8e3d-243dc422f018(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f416d75-af93-4e01-a681-6a5a3972deb5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:23 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a.fe90eebd-bbf8-4fb9-b631-42fb3185fcce" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-fe90eebd-bbf8-4fb9-b631-42fb3185fcce" released by "_delete_snapshot" :: held 1.781s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f700d60a-45c3-4553-b09f-747fd4cda96a" released by "delete_snapshot" :: held 1.804s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:23 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 Nov 06 21:45:23 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Created reservations ['67a1ecc7-8087-4829-aa33-5f6975b039e3', 'a1ea1f4c-b717-4e5a-b7c6-7eb0855e5af1', 'afbc9e1b-efb5-484d-91f6-417e085c4e58', '24d5e990-b595-4c29-ba51-6b68f616a65d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Delete snapshot completed successfully. Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2d261fe3-5f14-45e4-ada7-2b8298117012 tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-fe90eebd-bbf8-4fb9-b631-42fb3185fcce-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:24 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:24 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a Nov 06 21:45:24 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-f700d60a-45c3-4553-b09f-747fd4cda96a-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-f700d60a-45c3-4553-b09f-747fd4cda96a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-f700d60a-45c3-4553-b09f-747fd4cda96a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f700d60a-45c3-4553-b09f-747fd4cda96a" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b372ba8d-a79d-4d68-8561-7b79e6175cb8]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:24 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a" returned: 0 in 0.355s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:24 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a Nov 06 21:45:24 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:24 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a Nov 06 21:45:24 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:24 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018.40728bbe-c06a-4117-a501-53923d2fed1a" returned: 0 in 0.282s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:24 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a" returned: 0 in 0.415s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:24 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a Nov 06 21:45:24 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-quobyte-40728bbe-c06a-4117-a501-53923d2fed1a" released by "_delete_snapshot" :: held 1.578s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-quobyte-71fd6cee-d11c-4574-8e3d-243dc422f018" released by "delete_snapshot" :: held 1.603s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Created reservations ['b0c7bd01-37af-4963-a263-b32a5b5dee16', '1d88b941-6b87-440d-9fa3-cb48f606028e', '24be4e70-6b3e-4ed8-aaab-ae3acdf8857c', '536dad26-1202-435b-ada4-9af3cb5a87bb'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Delete snapshot completed successfully. Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8f35fd64-0176-4c75-b342-2003c62d6b4e tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-40728bbe-c06a-4117-a501-53923d2fed1a-delete_snapshot" released by "delete_snapshot" :: held 1.780s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:25 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f700d60a-45c3-4553-b09f-747fd4cda96a" returned: 0 in 0.291s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-f700d60a-45c3-4553-b09f-747fd4cda96a" released by "delete_volume" :: held 0.788s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Created reservations ['3640cd65-2c74-4dd0-903e-150feb95e85e', '03056d03-b8af-4d88-88b5-069cd8a09975', '8fcbc710-5f0e-4640-a116-fda8413601a6', '03d59c8b-0e0b-4f58-a1b0-1df8cd6dd559'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:25 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:25 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "cinder-71fd6cee-d11c-4574-8e3d-243dc422f018-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-71fd6cee-d11c-4574-8e3d-243dc422f018-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:25 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.274s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Deleted volume successfully. Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-44653783-b52c-4791-a7f9-f1ddfe724845-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "cinder-quobyte-71fd6cee-d11c-4574-8e3d-243dc422f018" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-44653783-b52c-4791-a7f9-f1ddfe724845-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a69a65b5-9f88-44a6-a75a-393becb498de tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-f700d60a-45c3-4553-b09f-747fd4cda96a-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-quobyte-71fd6cee-d11c-4574-8e3d-243dc422f018" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "cinder-quobyte-44653783-b52c-4791-a7f9-f1ddfe724845" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1cd854-a8f8-4d23-916b-b85834081ec8]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-44653783-b52c-4791-a7f9-f1ddfe724845" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5686e386-a71a-4fe0-9413-887d333f8041]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:25 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 Nov 06 21:45:25 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:25 devstack sudo[96125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 Nov 06 21:45:25 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:26 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018" returned: 0 in 0.422s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:26 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018 Nov 06 21:45:26 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:26 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845" returned: 0 in 0.431s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:26 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845 Nov 06 21:45:26 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:26 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-71fd6cee-d11c-4574-8e3d-243dc422f018" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-quobyte-71fd6cee-d11c-4574-8e3d-243dc422f018" released by "delete_volume" :: held 0.771s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:26 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44653783-b52c-4791-a7f9-f1ddfe724845" returned: 0 in 0.260s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-quobyte-44653783-b52c-4791-a7f9-f1ddfe724845" released by "delete_volume" :: held 0.777s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Created reservations ['1442ee5c-a1c7-495f-b48e-7293ae936752', 'b635092d-18d8-4194-a854-3170a840f5e7', '6045ac5b-a658-4b6d-a785-82b3d05c3e0a', '66816b22-cb88-46f3-a21a-3de3bb23ab42'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Created reservations ['ae55f835-9e27-4c31-9203-cec8115d54be', 'ed957616-e332-476d-add6-f09acb445485', 'd828664f-e881-45bf-8fae-0f2ddbff8db2', '189d6ee4-6392-40ee-bb91-1724405c1c1b'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:26 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:26 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:26 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:26 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:26 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.343s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:26 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:27 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Deleted volume successfully. Nov 06 21:45:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-396b357e-fa28-4fd2-92b8-151c52998b4a tempest-SnapshotMetadataTestJSON-1731305021 None] Lock "cinder-71fd6cee-d11c-4574-8e3d-243dc422f018-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:27 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.439s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:27 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:27 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Deleted volume successfully. Nov 06 21:45:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d7cb8883-68be-4300-be1c-aa3626fea11f tempest-VolumesSnapshotTestJSON-1136938097 None] Lock "cinder-44653783-b52c-4791-a7f9-f1ddfe724845-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Flow 'volume_create_manager' (627ec56b-98e0-4f0a-ac4f-f68f291377f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07e2911-01b2-4a99-87f6-d57afdd88a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07e2911-01b2-4a99-87f6-d57afdd88a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-483445724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c044ffab-5d11-4cb9-9e4d-9a5287c59997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db178115a07e4d2bbccfd7ca7117e410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:32Z,use_quota=True,user_id='a1e134824d9643a9bbf3236ce8ff5f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de2cd6c-2b19-4bc9-a2e9-d3a008d7138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de2cd6c-2b19-4bc9-a2e9-d3a008d7138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a0e8e2-0b21-42bc-b35f-42350bb849f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a0e8e2-0b21-42bc-b35f-42350bb849f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c044ffab-5d11-4cb9-9e4d-9a5287c59997', 'volume_name': 'volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9ec085-8eea-4203-bbd6-41154503faa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9ec085-8eea-4203-bbd6-41154503faa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ff9c2e-91bd-4a87-b049-088888b049f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Volume c044ffab-5d11-4cb9-9e4d-9a5287c59997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997', 'volume_size': 1} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-483445724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c044ffab-5d11-4cb9-9e4d-9a5287c59997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db178115a07e4d2bbccfd7ca7117e410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:32Z,use_quota=True,user_id='a1e134824d9643a9bbf3236ce8ff5f81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Creating volume c044ffab-5d11-4cb9-9e4d-9a5287c59997 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:45:32 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:45:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:32 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 1073741824 Nov 06 21:45:32 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:33 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 1073741824" returned: 0 in 0.520s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:33 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 Nov 06 21:45:33 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:33 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997" returned: 0 in 0.306s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ff9c2e-91bd-4a87-b049-088888b049f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afecb7da-d42c-46e0-89d6-e68574b2d39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:33 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Volume volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 (c044ffab-5d11-4cb9-9e4d-9a5287c59997): created successfully Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afecb7da-d42c-46e0-89d6-e68574b2d39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Flow 'volume_create_manager' (627ec56b-98e0-4f0a-ac4f-f68f291377f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:33 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-da741b92-4d76-463f-92f2-b4b2155a85af tempest-VolumesMetadataTest-150837002 None] Created volume successfully. Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Acquiring lock "cinder-c044ffab-5d11-4cb9-9e4d-9a5287c59997-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Lock "cinder-c044ffab-5d11-4cb9-9e4d-9a5287c59997-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Flow 'volume_create_manager' (5705ddfd-b4ec-40b1-bce0-537312f18074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0ff36d-b981-43e2-9174-64e8f5e06e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f0ff36d-b981-43e2-9174-64e8f5e06e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1181580489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3c9b14-385d-4213-8775-2a4c9dc20a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5cb0b394d94f4d9c7644a296201f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:36Z,use_quota=True,user_id='dba7caec2763459b92d46dbb2efc35a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce5e559-96f9-4e9f-8206-1163e1debe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce5e559-96f9-4e9f-8206-1163e1debe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6f5008-8803-45b4-90a3-d0d9e37044e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6f5008-8803-45b4-90a3-d0d9e37044e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa3c9b14-385d-4213-8775-2a4c9dc20a5a', 'volume_name': 'volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ce278b-83cc-420e-ae03-3dbec023d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ce278b-83cc-420e-ae03-3dbec023d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de36b79-a88b-4467-98e6-4c47ee85f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:35 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Volume fa3c9b14-385d-4213-8775-2a4c9dc20a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a', 'volume_size': 1} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1181580489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa3c9b14-385d-4213-8775-2a4c9dc20a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5cb0b394d94f4d9c7644a296201f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:36Z,use_quota=True,user_id='dba7caec2763459b92d46dbb2efc35a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Creating volume fa3c9b14-385d-4213-8775-2a4c9dc20a5a {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:45:35 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Acquiring lock "cinder-quobyte-c044ffab-5d11-4cb9-9e4d-9a5287c59997" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:35 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a 1073741824 Nov 06 21:45:35 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Lock "cinder-quobyte-c044ffab-5d11-4cb9-9e4d-9a5287c59997" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[02936a6b-b8fd-4c72-bb59-ea36b4cf5837]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:35 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 Nov 06 21:45:35 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:36 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997" returned: 0 in 0.554s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:36 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997 Nov 06 21:45:36 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:36 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a 1073741824" returned: 0 in 0.730s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:36 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a Nov 06 21:45:36 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:36 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c044ffab-5d11-4cb9-9e4d-9a5287c59997" returned: 0 in 0.349s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Lock "cinder-quobyte-c044ffab-5d11-4cb9-9e4d-9a5287c59997" released by "delete_volume" :: held 0.974s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Created reservations ['56c2634a-38df-49bd-948c-ca88b0cae20a', '329d4582-90b6-4a58-b162-a84de2922516', '531dee59-0fba-4170-a0c6-1bdfc5597791', '6d90a305-6d47-4394-88ea-68bc52368567'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:36 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a" returned: 0 in 0.404s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de36b79-a88b-4467-98e6-4c47ee85f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9402cab9-7cbe-4c68-8e7a-a5aabfbaec5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:36 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:36 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:36 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Volume volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a (fa3c9b14-385d-4213-8775-2a4c9dc20a5a): created successfully Nov 06 21:45:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9402cab9-7cbe-4c68-8e7a-a5aabfbaec5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Flow 'volume_create_manager' (5705ddfd-b4ec-40b1-bce0-537312f18074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d3be9fd3-1222-4652-93b9-5d9529ea9cc2 tempest-AttachVolumeNegativeTest-833279720 None] Created volume successfully. Nov 06 21:45:37 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:37 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Deleted volume successfully. Nov 06 21:45:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5448849e-d315-4c90-9237-f76ac78c836d tempest-VolumesMetadataTest-150837002 None] Lock "cinder-c044ffab-5d11-4cb9-9e4d-9a5287c59997-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-579a6855-b0cc-4b3d-9a17-dcb88e4dda7c req-d23f1d89-c987-432f-9e3f-6936d50bfba8 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-579a6855-b0cc-4b3d-9a17-dcb88e4dda7c req-d23f1d89-c987-432f-9e3f-6936d50bfba8 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-579a6855-b0cc-4b3d-9a17-dcb88e4dda7c req-d23f1d89-c987-432f-9e3f-6936d50bfba8 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-579a6855-b0cc-4b3d-9a17-dcb88e4dda7c req-d23f1d89-c987-432f-9e3f-6936d50bfba8 tempest-AttachVolumeNegativeTest-833279720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa91b275-28b3-400b-af54-a0a0c06c38b5', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:45:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-579a6855-b0cc-4b3d-9a17-dcb88e4dda7c req-d23f1d89-c987-432f-9e3f-6936d50bfba8 tempest-AttachVolumeNegativeTest-833279720 None] attachment_update completed successfully. Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Flow 'volume_create_manager' (931469d5-b5ec-4c5f-a768-186d8c1e9605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5744a4b-7df2-4ddc-9882-ba00b0eea2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5744a4b-7df2-4ddc-9882-ba00b0eea2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-519826188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b3c8799fc54a97a7e0df4c4eec7936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:45Z,use_quota=True,user_id='5320b92039c34aa8911e4abb7d6cbe61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b374df-7b79-4556-b8da-af0d796459cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3b374df-7b79-4556-b8da-af0d796459cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71e4dfc-9afe-4e54-8e06-90a4ab1b0de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a71e4dfc-9afe-4e54-8e06-90a4ab1b0de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77', 'volume_name': 'volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326e5052-1d65-4ff3-87ac-217ccca1b5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326e5052-1d65-4ff3-87ac-217ccca1b5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65e8baa-d262-4985-968a-a1d65c83d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:44 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Volume 6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77', 'volume_size': 1} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-519826188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b3c8799fc54a97a7e0df4c4eec7936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:45Z,use_quota=True,user_id='5320b92039c34aa8911e4abb7d6cbe61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Creating volume 6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:45:44 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:45:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:44 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 1073741824 Nov 06 21:45:44 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:45 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 1073741824" returned: 0 in 0.779s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:45 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 Nov 06 21:45:45 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:45 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:45:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65e8baa-d262-4985-968a-a1d65c83d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310facd9-0f66-4954-a2fc-bcaf33719eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:46 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Volume volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 (6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77): created successfully Nov 06 21:45:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310facd9-0f66-4954-a2fc-bcaf33719eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Flow 'volume_create_manager' (931469d5-b5ec-4c5f-a768-186d8c1e9605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-49afa7b9-1753-4b2b-985c-eebf424f9b8c tempest-VolumesTransfersTest-428850670 None] Created volume successfully. Nov 06 21:45:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-291b9394-3c28-47cc-ad79-0f09e43cdb2c tempest-VolumesTransfersTest-1067622694 None] Transfer volume completed successfully. Nov 06 21:45:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Acquiring lock "cinder-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Lock "cinder-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Acquiring lock "cinder-quobyte-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Lock "cinder-quobyte-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77" acquired by "delete_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:49 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b358df1-c93c-4d8d-8dcf-20f78b39cbc6]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:49 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 Nov 06 21:45:49 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:49 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77" returned: 0 in 0.521s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:49 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77 Nov 06 21:45:49 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:49 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77" returned: 0 in 0.466s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Lock "cinder-quobyte-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77" released by "delete_volume" :: held 1.078s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Created reservations ['d339c18b-5835-46e4-8a04-ef7f3e1665ad', '07350d33-b1c5-4aa6-a9bd-71e07166bcd3', 'b2f23400-f885-43cf-9c20-dbb427415e2f', 'e4d711ff-71be-433c-b198-3c634683ad43'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:50 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:50 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:50 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.352s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Deleted volume successfully. Nov 06 21:45:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ebd3b818-5f49-4026-a2b2-407b7549c8e8 tempest-VolumesTransfersTest-251744527 None] Lock "cinder-6a44e7eb-9f6a-4ec3-9f5a-61f344ddbf77-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Flow 'volume_create_manager' (4e023da1-3c34-4984-a27c-9a9993a056aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccd51b0-925b-4b37-b9d8-317e67a41eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccd51b0-925b-4b37-b9d8-317e67a41eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-911494269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09c91a4-ad33-49b5-ae75-736b5079d7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b3c8799fc54a97a7e0df4c4eec7936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:52Z,use_quota=True,user_id='5320b92039c34aa8911e4abb7d6cbe61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864a65a4-b245-4c63-bfcf-29e0f55085d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864a65a4-b245-4c63-bfcf-29e0f55085d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433470e9-5fe2-4d6d-bc15-67782ed9aefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (433470e9-5fe2-4d6d-bc15-67782ed9aefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09c91a4-ad33-49b5-ae75-736b5079d7d2', 'volume_name': 'volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e879339-07f8-4e1d-a7ce-eb2b29fc1faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e879339-07f8-4e1d-a7ce-eb2b29fc1faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64af78f-9eca-420d-948c-5f3144df2f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:52 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Volume e09c91a4-ad33-49b5-ae75-736b5079d7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2', 'volume_size': 1} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-911494269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e09c91a4-ad33-49b5-ae75-736b5079d7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b3c8799fc54a97a7e0df4c4eec7936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:45:52Z,use_quota=True,user_id='5320b92039c34aa8911e4abb7d6cbe61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Creating volume e09c91a4-ad33-49b5-ae75-736b5079d7d2 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:45:52 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:52 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 1073741824 Nov 06 21:45:52 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:52 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 1073741824" returned: 0 in 0.511s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:52 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 Nov 06 21:45:52 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:52 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2" returned: 0 in 0.272s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64af78f-9eca-420d-948c-5f3144df2f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b33033a-be4c-47ad-8814-0348b8bc9934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:45:52 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Volume volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 (e09c91a4-ad33-49b5-ae75-736b5079d7d2): created successfully Nov 06 21:45:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b33033a-be4c-47ad-8814-0348b8bc9934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:45:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Flow 'volume_create_manager' (4e023da1-3c34-4984-a27c-9a9993a056aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:45:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-39bc79d2-30c1-41b3-a22b-f6d2761226af tempest-VolumesTransfersTest-428850670 None] Created volume successfully. Nov 06 21:45:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Acquiring lock "cinder-e09c91a4-ad33-49b5-ae75-736b5079d7d2-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Lock "cinder-e09c91a4-ad33-49b5-ae75-736b5079d7d2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Acquiring lock "cinder-quobyte-e09c91a4-ad33-49b5-ae75-736b5079d7d2" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:45:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Lock "cinder-quobyte-e09c91a4-ad33-49b5-ae75-736b5079d7d2" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:45:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a3feae-7dc5-4279-9e12-b4aa1f510b2c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:45:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:54 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 Nov 06 21:45:54 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:54 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2" returned: 0 in 0.456s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:55 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2 Nov 06 21:45:55 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:55 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e09c91a4-ad33-49b5-ae75-736b5079d7d2" returned: 0 in 0.330s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Lock "cinder-quobyte-e09c91a4-ad33-49b5-ae75-736b5079d7d2" released by "delete_volume" :: held 0.843s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Created reservations ['dab46792-bed5-467b-b2f0-9d2635cafb4a', 'c16d342a-3a1d-4ec9-a814-0ecf74bbeda6', 'b694e8d4-0e90-406d-a2e3-13fa046e34b3', '2a5c1064-1a01-42c2-9762-09dd6b2f320f'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:55 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:55 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:55 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.343s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:55 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Deleted volume successfully. Nov 06 21:45:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-155c2701-0834-486f-876b-3a2dc5fe139c tempest-VolumesTransfersTest-251744527 None] Lock "cinder-e09c91a4-ad33-49b5-ae75-736b5079d7d2-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:45:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:45:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:45:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:45:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:45:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:45:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:45:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:45:58 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:45:58 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:45:59 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Nov 06 21:45:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.515s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:45:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:45:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:45:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:45:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Flow 'volume_create_manager' (62157fc8-ab0c-4092-8a02-1de3fe58bcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ef42c1-51ed-493b-8f1c-17cb502fc35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ef42c1-51ed-493b-8f1c-17cb502fc35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-697589187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4ed19d-160d-4b6d-89ba-13abe328c7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f793475e5cf243c98764880ed3224563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:02Z,use_quota=True,user_id='e3483070fd60482c856279d96b1e651d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52fd278c-4b07-4fa1-a990-8abcb0199504),volume_type_id=52fd278c-4b07-4fa1-a990-8abcb0199504)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c36c030-95fc-4ff7-94c6-6151e3fc5449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c36c030-95fc-4ff7-94c6-6151e3fc5449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded5de84-d091-4f2d-bb9e-05213d3f9e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded5de84-d091-4f2d-bb9e-05213d3f9e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4ed19d-160d-4b6d-89ba-13abe328c7ca', 'volume_name': 'volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a797ea-e918-4783-88f8-bb74abde0922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a797ea-e918-4783-88f8-bb74abde0922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e115e6-3382-43a4-bbc2-a8fc36d26436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Volume 7a4ed19d-160d-4b6d-89ba-13abe328c7ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca', 'volume_size': 1} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-697589187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4ed19d-160d-4b6d-89ba-13abe328c7ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f793475e5cf243c98764880ed3224563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:02Z,use_quota=True,user_id='e3483070fd60482c856279d96b1e651d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52fd278c-4b07-4fa1-a990-8abcb0199504),volume_type_id=52fd278c-4b07-4fa1-a990-8abcb0199504)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Creating volume 7a4ed19d-160d-4b6d-89ba-13abe328c7ca {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:46:02 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:46:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:02 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca 1073741824 Nov 06 21:46:02 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:03 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca 1073741824" returned: 0 in 0.861s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:03 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca Nov 06 21:46:03 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:04 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca" returned: 0 in 0.513s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:46:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e115e6-3382-43a4-bbc2-a8fc36d26436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192287b1-5dd4-4557-9606-bef14bb9335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:04 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Volume volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca (7a4ed19d-160d-4b6d-89ba-13abe328c7ca): created successfully Nov 06 21:46:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192287b1-5dd4-4557-9606-bef14bb9335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Flow 'volume_create_manager' (62157fc8-ab0c-4092-8a02-1de3fe58bcc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4c9e3b39-7355-4c17-917b-7d9636d38d47 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Created volume successfully. Nov 06 21:46:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:05 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:05 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:06 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.526s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:06 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-68e5559a-1984-4bd6-9fbf-5e4bb6c2ad8e tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Retype volume completed successfully. Nov 06 21:46:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Acquiring lock "cinder-7a4ed19d-160d-4b6d-89ba-13abe328c7ca-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "cinder-7a4ed19d-160d-4b6d-89ba-13abe328c7ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:07 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=112,cinder:SELECT=91,cinder:DELETE=7,cinder:INSERT=29 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:46:07 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=95,cinder:UPDATE=116,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:46:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Acquiring lock "cinder-quobyte-7a4ed19d-160d-4b6d-89ba-13abe328c7ca" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "cinder-quobyte-7a4ed19d-160d-4b6d-89ba-13abe328c7ca" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:07 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a03e52b-5c55-4126-b0da-4c2400f96151]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:46:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:07 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca Nov 06 21:46:07 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:08 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca" returned: 0 in 0.644s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:08 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca Nov 06 21:46:08 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:08 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a4ed19d-160d-4b6d-89ba-13abe328c7ca" returned: 0 in 0.387s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "cinder-quobyte-7a4ed19d-160d-4b6d-89ba-13abe328c7ca" released by "delete_volume" :: held 1.110s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:08 devstack cinder-volume[87069]: WARNING cinder.quota [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:46:08 devstack cinder-volume[87069]: WARNING cinder.quota [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Created reservations ['395599d9-b220-4dbd-bea3-96770106f9e8', 'fff5adb7-525d-415e-8ca0-ab4b5a102c9a', '9023ddcc-b9bf-420d-a653-536d70c3d0f3', '9cb5e518-0725-42a3-81a5-4b10ef92e756'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:08 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:08 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:09 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.365s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:09 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:09 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Deleted volume successfully. Nov 06 21:46:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-accc7313-681c-45c0-9c62-b36a197b1cf0 tempest-VolumeRetypeWithoutMigrationTest-1277555780 None] Lock "cinder-7a4ed19d-160d-4b6d-89ba-13abe328c7ca-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Flow 'volume_create_manager' (1612e5ec-356f-481a-b924-6a67aa82fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (babe0cfc-5eb9-4492-8b2e-8057c3c9531f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (babe0cfc-5eb9-4492-8b2e-8057c3c9531f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1483254052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6b29be-98a1-43f1-a8cb-7646738ba27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ce6f6dab254b39b5f35271ee1fc352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:13Z,use_quota=True,user_id='829b879caded4d8d93741369ea3cc467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519d5afd-3bc7-47e4-a0f7-40568fa49721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519d5afd-3bc7-47e4-a0f7-40568fa49721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208a569e-d561-40ab-8971-2ae14f2c9804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208a569e-d561-40ab-8971-2ae14f2c9804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6b29be-98a1-43f1-a8cb-7646738ba27f', 'volume_name': 'volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef49c672-f5dc-49b3-954f-d2e7db26b438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef49c672-f5dc-49b3-954f-d2e7db26b438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6047a57d-cf13-4ddd-85b8-06fffa5340f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:12 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Volume ff6b29be-98a1-43f1-a8cb-7646738ba27f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f', 'volume_size': 1} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1483254052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6b29be-98a1-43f1-a8cb-7646738ba27f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ce6f6dab254b39b5f35271ee1fc352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:13Z,use_quota=True,user_id='829b879caded4d8d93741369ea3cc467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Creating volume ff6b29be-98a1-43f1-a8cb-7646738ba27f {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:46:12 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:46:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:13 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f 1073741824 Nov 06 21:46:13 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:13 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f 1073741824" returned: 0 in 0.867s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:14 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f Nov 06 21:46:14 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:14 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f" returned: 0 in 0.457s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:46:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6047a57d-cf13-4ddd-85b8-06fffa5340f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557ed64e-50f6-4b23-953c-bb73623a02f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Volume volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f (ff6b29be-98a1-43f1-a8cb-7646738ba27f): created successfully Nov 06 21:46:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557ed64e-50f6-4b23-953c-bb73623a02f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Flow 'volume_create_manager' (1612e5ec-356f-481a-b924-6a67aa82fe13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-574ab325-8e45-4992-8157-881818f1d927 tempest-VolumesTransfersV355Test-841925470 None] Created volume successfully. Nov 06 21:46:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-eb3944c4-39e4-4715-9409-cb33b35a1e24 tempest-VolumesTransfersV355Test-816160704 None] Transfer volume completed successfully. Nov 06 21:46:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Acquiring lock "cinder-ff6b29be-98a1-43f1-a8cb-7646738ba27f-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Lock "cinder-ff6b29be-98a1-43f1-a8cb-7646738ba27f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Acquiring lock "cinder-quobyte-ff6b29be-98a1-43f1-a8cb-7646738ba27f" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Lock "cinder-quobyte-ff6b29be-98a1-43f1-a8cb-7646738ba27f" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:17 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f4b96a-1fe3-4561-a14c-cd068302a911]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:46:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:17 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f Nov 06 21:46:17 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:17 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f" returned: 0 in 0.380s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:17 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f Nov 06 21:46:17 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:18 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ff6b29be-98a1-43f1-a8cb-7646738ba27f" returned: 0 in 0.306s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Lock "cinder-quobyte-ff6b29be-98a1-43f1-a8cb-7646738ba27f" released by "delete_volume" :: held 0.748s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Created reservations ['bb36c87f-8599-4955-8b01-294a1a72f74a', '47722c40-fb21-4137-8691-3e0202c8ecf6', '7ea15a87-8dc1-438e-bff7-0eb2811922bf', 'a9b7f8d4-8e4d-411d-bf90-d6d8eee3fc81'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:18 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:18 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:18 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Deleted volume successfully. Nov 06 21:46:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7979bb26-4fe6-4aae-a82f-2e63cb8d14bc tempest-VolumesTransfersV355Test-127504857 None] Lock "cinder-ff6b29be-98a1-43f1-a8cb-7646738ba27f-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Flow 'volume_create_manager' (e64fb9af-200c-4177-870a-2c9ee0e3f175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db747025-0804-4ccd-b9b9-551a2d018e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db747025-0804-4ccd-b9b9-551a2d018e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1419596451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7997d481-fa06-42ab-9188-7e1bcab574d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ce6f6dab254b39b5f35271ee1fc352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:19Z,use_quota=True,user_id='829b879caded4d8d93741369ea3cc467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb76e77d-57ec-40c7-82b3-1fb9b2088bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb76e77d-57ec-40c7-82b3-1fb9b2088bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1422ef0f-3ac0-4add-813f-de5a0dafcddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1422ef0f-3ac0-4add-813f-de5a0dafcddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7997d481-fa06-42ab-9188-7e1bcab574d1', 'volume_name': 'volume-7997d481-fa06-42ab-9188-7e1bcab574d1', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e38f080-05ed-4b5d-8f84-277fce1922b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e38f080-05ed-4b5d-8f84-277fce1922b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8505d8de-3765-4a12-affe-7d41ad19a787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Volume 7997d481-fa06-42ab-9188-7e1bcab574d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7997d481-fa06-42ab-9188-7e1bcab574d1', 'volume_size': 1} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1419596451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7997d481-fa06-42ab-9188-7e1bcab574d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ce6f6dab254b39b5f35271ee1fc352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:19Z,use_quota=True,user_id='829b879caded4d8d93741369ea3cc467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Creating volume 7997d481-fa06-42ab-9188-7e1bcab574d1 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:46:19 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:19 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 1073741824 Nov 06 21:46:19 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Flow 'volume_create_manager' (5180308a-5cd5-4eb4-8a83-a8ec3489a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad4105c-245d-449f-8d15-1c6dee3ddd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad4105c-245d-449f-8d15-1c6dee3ddd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1635889887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79352a29-ce0c-4e24-bb31-a1eec05c700e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87b3299bf534724b470389d4634d1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:20Z,use_quota=True,user_id='1f2a09ddc7a449e086076dd51550bc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a90b53d-da63-4e6c-8786-4d27fcd86480),volume_type_id=2a90b53d-da63-4e6c-8786-4d27fcd86480)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad97e16f-714f-455c-9147-9e75e09453e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad97e16f-714f-455c-9147-9e75e09453e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28f6659-fc38-4f04-b2a5-e1c672d5499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28f6659-fc38-4f04-b2a5-e1c672d5499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79352a29-ce0c-4e24-bb31-a1eec05c700e', 'volume_name': 'volume-79352a29-ce0c-4e24-bb31-a1eec05c700e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f0f375-beac-48d5-8ee6-c15f061d9463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f0f375-beac-48d5-8ee6-c15f061d9463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850c4e72-ff4f-4e21-9b7e-9eb306253e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Volume 79352a29-ce0c-4e24-bb31-a1eec05c700e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79352a29-ce0c-4e24-bb31-a1eec05c700e', 'volume_size': 1} Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:19 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 1073741824" returned: 0 in 0.530s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:20 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 Nov 06 21:46:20 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:20 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.310s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1635889887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79352a29-ce0c-4e24-bb31-a1eec05c700e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87b3299bf534724b470389d4634d1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:20Z,use_quota=True,user_id='1f2a09ddc7a449e086076dd51550bc5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a90b53d-da63-4e6c-8786-4d27fcd86480),volume_type_id=2a90b53d-da63-4e6c-8786-4d27fcd86480)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Creating volume 79352a29-ce0c-4e24-bb31-a1eec05c700e {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:46:20 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8505d8de-3765-4a12-affe-7d41ad19a787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7997d481-fa06-42ab-9188-7e1bcab574d1', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e645fc-ee61-4d25-83ed-26e2eee897af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:20 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e 1073741824 Nov 06 21:46:20 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:20 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Volume volume-7997d481-fa06-42ab-9188-7e1bcab574d1 (7997d481-fa06-42ab-9188-7e1bcab574d1): created successfully Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e645fc-ee61-4d25-83ed-26e2eee897af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Flow 'volume_create_manager' (e64fb9af-200c-4177-870a-2c9ee0e3f175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1e9b95f4-2964-47aa-ab3e-208360da81ac tempest-VolumesTransfersV355Test-841925470 None] Created volume successfully. Nov 06 21:46:20 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e 1073741824" returned: 0 in 0.452s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:20 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e Nov 06 21:46:20 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:21 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850c4e72-ff4f-4e21-9b7e-9eb306253e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79352a29-ce0c-4e24-bb31-a1eec05c700e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e584ce-95da-43dc-8b84-c837ef0bdb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:21 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Volume volume-79352a29-ce0c-4e24-bb31-a1eec05c700e (79352a29-ce0c-4e24-bb31-a1eec05c700e): created successfully Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e584ce-95da-43dc-8b84-c837ef0bdb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Flow 'volume_create_manager' (5180308a-5cd5-4eb4-8a83-a8ec3489a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cd45a9f7-9019-4f7c-81c2-2c586d6e753a tempest-VolumeTypesAccessTest-820393823 None] Created volume successfully. Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Acquiring lock "cinder-7997d481-fa06-42ab-9188-7e1bcab574d1-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Lock "cinder-7997d481-fa06-42ab-9188-7e1bcab574d1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Acquiring lock "cinder-quobyte-7997d481-fa06-42ab-9188-7e1bcab574d1" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Lock "cinder-quobyte-7997d481-fa06-42ab-9188-7e1bcab574d1" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5571e7f5-645a-44c5-9d29-4cef53f4a93d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:21 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 Nov 06 21:46:21 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Acquiring lock "cinder-79352a29-ce0c-4e24-bb31-a1eec05c700e-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Lock "cinder-79352a29-ce0c-4e24-bb31-a1eec05c700e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Acquiring lock "cinder-quobyte-79352a29-ce0c-4e24-bb31-a1eec05c700e" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Lock "cinder-quobyte-79352a29-ce0c-4e24-bb31-a1eec05c700e" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[277bd190-a3c7-43ea-bcc4-63c8c823205f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:22 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1" returned: 0 in 0.516s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:22 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1 Nov 06 21:46:22 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:22 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e Nov 06 21:46:22 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:22 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7997d481-fa06-42ab-9188-7e1bcab574d1" returned: 0 in 0.275s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Lock "cinder-quobyte-7997d481-fa06-42ab-9188-7e1bcab574d1" released by "delete_volume" :: held 0.872s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:22 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e" returned: 0 in 0.444s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:22 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e Nov 06 21:46:22 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Created reservations ['6eb3f8cc-f377-4b7c-b453-6f28475e3f01', '496fd086-3f7c-496d-be6a-40b1e835a751', '2f4c61a4-3a13-4663-b446-8419773c09d0', '810bcf42-3958-4cf2-be2e-50aa594ff598'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:22 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:22 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:23 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-79352a29-ce0c-4e24-bb31-a1eec05c700e" returned: 0 in 0.412s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Lock "cinder-quobyte-79352a29-ce0c-4e24-bb31-a1eec05c700e" released by "delete_volume" :: held 0.943s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:23 devstack cinder-volume[87069]: WARNING cinder.quota [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1178565166 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1178565166, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:46:23 devstack cinder-volume[87069]: WARNING cinder.quota [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1178565166 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1178565166, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:46:23 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Created reservations ['1641f4d7-33a9-48d0-90aa-76f82091f445', '5e53afb9-40e9-417a-90e2-b54b56af2c9f', 'e805983c-dc73-4987-9141-9fc63a6a4e59', 'c5480718-5289-45a9-b841-dbdf64b593a6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.428s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Deleted volume successfully. Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-668830f8-94c5-4d28-bbd8-12312e58e1fb tempest-VolumesTransfersV355Test-127504857 None] Lock "cinder-7997d481-fa06-42ab-9188-7e1bcab574d1-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:23 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:23 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:23 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.275s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Deleted volume successfully. Nov 06 21:46:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e92ebcc-b29a-421d-9a95-21417ecb3ede tempest-VolumeTypesAccessTest-820393823 None] Lock "cinder-79352a29-ce0c-4e24-bb31-a1eec05c700e-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:31 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-65be2319-4495-4cf7-91bf-137d947107f6 req-fdf493eb-0445-4cee-a6c8-05a988a9509c tempest-AttachVolumeNegativeTest-833279720 None] Terminate volume connection completed successfully. Nov 06 21:46:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-65be2319-4495-4cf7-91bf-137d947107f6 req-fdf493eb-0445-4cee-a6c8-05a988a9509c tempest-AttachVolumeNegativeTest-833279720 None] Deleting attachment fa91b275-28b3-400b-af54-a0a0c06c38b5. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Flow 'volume_create_manager' (fa0d687b-03e9-478f-8d92-739ceeef90d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8aadd45-cf57-47b3-aabb-77919518043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8aadd45-cf57-47b3-aabb-77919518043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-743573992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef5b266-5c8b-4a34-9060-c5ed989b458d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3adf01ab91647f0a24261629ac1f0f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:35Z,use_quota=True,user_id='cfccb615344d4b7f8c7c9b488f5add0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a758e14f-e033-4f94-aae5-f1b27f12761f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a758e14f-e033-4f94-aae5-f1b27f12761f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d586c3-cad5-4699-85bc-1913c7b363ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d586c3-cad5-4699-85bc-1913c7b363ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef5b266-5c8b-4a34-9060-c5ed989b458d', 'volume_name': 'volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8703604-d007-46bf-9bb5-213a40f7c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8703604-d007-46bf-9bb5-213a40f7c278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b33f3a2-4bb9-4718-9003-5afb4483865e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:34 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Volume 5ef5b266-5c8b-4a34-9060-c5ed989b458d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d', 'volume_size': 1} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-743573992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ef5b266-5c8b-4a34-9060-c5ed989b458d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3adf01ab91647f0a24261629ac1f0f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:35Z,use_quota=True,user_id='cfccb615344d4b7f8c7c9b488f5add0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Creating volume 5ef5b266-5c8b-4a34-9060-c5ed989b458d {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:46:34 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:46:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:34 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d 1073741824 Nov 06 21:46:34 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:35 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d 1073741824" returned: 0 in 0.711s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:35 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d Nov 06 21:46:35 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:35 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d" returned: 0 in 0.283s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b33f3a2-4bb9-4718-9003-5afb4483865e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe1f8bc-1626-4540-9d24-d5719240b6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:35 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Volume volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d (5ef5b266-5c8b-4a34-9060-c5ed989b458d): created successfully Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe1f8bc-1626-4540-9d24-d5719240b6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Flow 'volume_create_manager' (fa0d687b-03e9-478f-8d92-739ceeef90d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:35 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b3be6926-2b92-4153-aeb3-ef88246eb34b tempest-VolumesTransfersV357Test-541969180 None] Created volume successfully. Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Flow 'volume_create_manager' (d25f7e1f-2a3d-48c8-b8ca-19d4d3925558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe016b6-7725-4ad4-93e2-4fd01807266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe016b6-7725-4ad4-93e2-4fd01807266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1750118466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1850ce-f940-4501-8abb-ef2faef25f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa043b9235c6425a9274c55c2687c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:36Z,use_quota=True,user_id='3ad18d734a2346bf8cfeac16135131ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57b7117-f5e2-4c54-a3cc-ec13138cc7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57b7117-f5e2-4c54-a3cc-ec13138cc7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9665a946-8911-4c9c-b18c-a461c08f52cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9665a946-8911-4c9c-b18c-a461c08f52cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d1850ce-f940-4501-8abb-ef2faef25f52', 'volume_name': 'volume-7d1850ce-f940-4501-8abb-ef2faef25f52', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd5a442-1bdb-4356-8fe8-40943316e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd5a442-1bdb-4356-8fe8-40943316e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75ba2c6-eacb-46f8-9fa2-7c72fa60f5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:36 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Volume 7d1850ce-f940-4501-8abb-ef2faef25f52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d1850ce-f940-4501-8abb-ef2faef25f52', 'volume_size': 1} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1750118466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1850ce-f940-4501-8abb-ef2faef25f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa043b9235c6425a9274c55c2687c5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:36Z,use_quota=True,user_id='3ad18d734a2346bf8cfeac16135131ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Creating volume 7d1850ce-f940-4501-8abb-ef2faef25f52 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:46:36 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:46:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:36 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 1073741824 Nov 06 21:46:36 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:37 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 1073741824" returned: 0 in 0.617s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:37 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 Nov 06 21:46:37 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:37 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52" returned: 0 in 0.355s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75ba2c6-eacb-46f8-9fa2-7c72fa60f5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d1850ce-f940-4501-8abb-ef2faef25f52', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b668c066-01b9-4800-8843-470e26fd8f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:37 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Volume volume-7d1850ce-f940-4501-8abb-ef2faef25f52 (7d1850ce-f940-4501-8abb-ef2faef25f52): created successfully Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b668c066-01b9-4800-8843-470e26fd8f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Flow 'volume_create_manager' (d25f7e1f-2a3d-48c8-b8ca-19d4d3925558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2fdc7eab-6e2f-4b1a-b3cd-fe56918398d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Created volume successfully. Nov 06 21:46:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-152b6d4b-db35-42f4-b243-0c84cac87744 tempest-VolumesTransfersV357Test-837248986 None] Transfer volume completed successfully. Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Acquiring lock "cinder-5ef5b266-5c8b-4a34-9060-c5ed989b458d-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Lock "cinder-5ef5b266-5c8b-4a34-9060-c5ed989b458d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Acquiring lock "cinder-quobyte-5ef5b266-5c8b-4a34-9060-c5ed989b458d" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Lock "cinder-quobyte-5ef5b266-5c8b-4a34-9060-c5ed989b458d" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ca6be-7982-461b-b0eb-d78c570cce78]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:39 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d Nov 06 21:46:39 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:39 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d" returned: 0 in 0.495s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:39 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d Nov 06 21:46:39 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-50e3409f-4f69-4d74-b071-13846600edf3 req-fdfc644f-b02a-4ee6-bb0d-4bc8b212a9e4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-50e3409f-4f69-4d74-b071-13846600edf3 req-fdfc644f-b02a-4ee6-bb0d-4bc8b212a9e4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-50e3409f-4f69-4d74-b071-13846600edf3 req-fdfc644f-b02a-4ee6-bb0d-4bc8b212a9e4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:39 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-50e3409f-4f69-4d74-b071-13846600edf3 req-fdfc644f-b02a-4ee6-bb0d-4bc8b212a9e4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-7d1850ce-f940-4501-8abb-ef2faef25f52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cac23ede-52c3-46ab-9435-8d2b3680365c', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:46:40 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-50e3409f-4f69-4d74-b071-13846600edf3 req-fdfc644f-b02a-4ee6-bb0d-4bc8b212a9e4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] attachment_update completed successfully. Nov 06 21:46:40 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5ef5b266-5c8b-4a34-9060-c5ed989b458d" returned: 0 in 0.359s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Lock "cinder-quobyte-5ef5b266-5c8b-4a34-9060-c5ed989b458d" released by "delete_volume" :: held 0.924s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Created reservations ['c6b27c11-7264-493b-b07c-75eb1e6a5a89', '07f33dd1-9698-4902-8513-36fcdb30b07f', '8c2f1a51-5e11-4681-bf4e-494611b82bf6', '044fed76-4dbc-458d-b1dc-a992d7477f84'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:40 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:40 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:40 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.334s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:40 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Deleted volume successfully. Nov 06 21:46:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4b2c8d9c-b98f-45ac-8b9e-791b2e49e192 tempest-VolumesTransfersV357Test-1036378059 None] Lock "cinder-5ef5b266-5c8b-4a34-9060-c5ed989b458d-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:41 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Flow 'volume_create_manager' (79b78df1-3eb6-4330-9931-4b9c503ae28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf5e929-fb1e-43fc-b060-234f421a7198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf5e929-fb1e-43fc-b060-234f421a7198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1118052247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57883811-e627-4f7e-9a6d-6201b52352c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3adf01ab91647f0a24261629ac1f0f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:42Z,use_quota=True,user_id='cfccb615344d4b7f8c7c9b488f5add0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7094b6b-f689-4685-a1ed-a8049b318e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7094b6b-f689-4685-a1ed-a8049b318e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8511fa7b-e7e5-4a3e-ab3d-bf3e6c76abe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8511fa7b-e7e5-4a3e-ab3d-bf3e6c76abe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57883811-e627-4f7e-9a6d-6201b52352c3', 'volume_name': 'volume-57883811-e627-4f7e-9a6d-6201b52352c3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f63f30e-8e81-4cae-bba3-c54b8c80cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f63f30e-8e81-4cae-bba3-c54b8c80cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a0e8a6-c513-406e-8ada-65cfb4dd8c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:42 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Volume 57883811-e627-4f7e-9a6d-6201b52352c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57883811-e627-4f7e-9a6d-6201b52352c3', 'volume_size': 1} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1118052247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57883811-e627-4f7e-9a6d-6201b52352c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3adf01ab91647f0a24261629ac1f0f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:46:42Z,use_quota=True,user_id='cfccb615344d4b7f8c7c9b488f5add0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Creating volume 57883811-e627-4f7e-9a6d-6201b52352c3 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:46:42 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:42 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 1073741824 Nov 06 21:46:42 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:42 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 1073741824" returned: 0 in 0.724s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:43 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 Nov 06 21:46:43 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:43 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3" returned: 0 in 0.434s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:46:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a0e8a6-c513-406e-8ada-65cfb4dd8c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57883811-e627-4f7e-9a6d-6201b52352c3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4657bdc-7a73-4232-80ab-885a20a9d381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:46:43 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Volume volume-57883811-e627-4f7e-9a6d-6201b52352c3 (57883811-e627-4f7e-9a6d-6201b52352c3): created successfully Nov 06 21:46:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4657bdc-7a73-4232-80ab-885a20a9d381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:46:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Flow 'volume_create_manager' (79b78df1-3eb6-4330-9931-4b9c503ae28d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:46:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2e1d1492-3b4e-4690-9327-4e86c0709486 tempest-VolumesTransfersV357Test-541969180 None] Created volume successfully. Nov 06 21:46:44 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-08941db5-1363-466f-a1b4-39899197d237 req-315d3977-46cc-44c0-a347-a62b2662c0de tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Terminate volume connection completed successfully. Nov 06 21:46:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-08941db5-1363-466f-a1b4-39899197d237 req-315d3977-46cc-44c0-a347-a62b2662c0de tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Deleting attachment cac23ede-52c3-46ab-9435-8d2b3680365c. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:46:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Acquiring lock "cinder-57883811-e627-4f7e-9a6d-6201b52352c3-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Lock "cinder-57883811-e627-4f7e-9a6d-6201b52352c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Acquiring lock "cinder-quobyte-57883811-e627-4f7e-9a6d-6201b52352c3" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Lock "cinder-quobyte-57883811-e627-4f7e-9a6d-6201b52352c3" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:44 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade8ed2b-41db-409b-99b1-cb2095465dbd]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:46:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:44 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 Nov 06 21:46:44 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:45 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3" returned: 0 in 0.507s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:45 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3 Nov 06 21:46:45 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Acquiring lock "cinder-7d1850ce-f940-4501-8abb-ef2faef25f52-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "cinder-7d1850ce-f940-4501-8abb-ef2faef25f52-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Acquiring lock "cinder-quobyte-7d1850ce-f940-4501-8abb-ef2faef25f52" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "cinder-quobyte-7d1850ce-f940-4501-8abb-ef2faef25f52" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:46:45 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-57883811-e627-4f7e-9a6d-6201b52352c3" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Lock "cinder-quobyte-57883811-e627-4f7e-9a6d-6201b52352c3" released by "delete_volume" :: held 0.931s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[338a9a31-95d8-42e7-adb3-18590aa3d53c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Created reservations ['87679090-ac31-41f4-a4ba-c49f029c6117', '5ff5510f-c2d1-46fd-afd3-20790ce1166b', 'e238364d-0b45-49cc-9f42-f9fc9ba624b2', 'ec0bb6de-2a0d-4bcd-b457-c273f0dc1887'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:46:45 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 Nov 06 21:46:45 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:45 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:45 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:46 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.284s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Deleted volume successfully. Nov 06 21:46:46 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52" returned: 0 in 0.556s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:46 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52 Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8607c744-4e26-4d2c-8354-d41a55ec0d34 tempest-VolumesTransfersV357Test-1036378059 None] Lock "cinder-57883811-e627-4f7e-9a6d-6201b52352c3-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:46 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:46 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d1850ce-f940-4501-8abb-ef2faef25f52" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "cinder-quobyte-7d1850ce-f940-4501-8abb-ef2faef25f52" released by "delete_volume" :: held 1.051s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Created reservations ['95b7dc1c-240f-426b-bb8a-ec76bf20de0e', '23ea59fc-9484-4aa7-ad44-73f540dd7eda', '8b39cf5a-ca55-4f03-b6e2-a71e971d5c40', 'eb2e5dca-07fa-4c35-9a22-c92678e626da'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:47 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:47 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:47 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.360s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:47 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Deleted volume successfully. Nov 06 21:46:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d983f19-c8e3-4018-9eb6-510ebeaec9d4 tempest-TestServerVolumeAttachScenarioOldVersion-8254272 None] Lock "cinder-7d1850ce-f940-4501-8abb-ef2faef25f52-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:46:56 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=57,cinder:INSERT=13,cinder:UPDATE=79,cinder:DELETE=3 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:46:57 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=55,cinder:INSERT=21,cinder:UPDATE=71,cinder:DELETE=10 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:46:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:46:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:46:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:46:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:46:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:46:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:46:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:46:58 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:46:58 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:46:59 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Nov 06 21:46:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.433s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:46:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:46:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:46:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:46:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Flow 'volume_create_manager' (ea2bac8f-93fb-4d38-ad5d-03a625d7e320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa790f71-1721-4d8f-804a-27759a94f246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa790f71-1721-4d8f-804a-27759a94f246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-341880872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed174b1e-6b22-4b85-9f71-732758cb3b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28367c17efc458989d5904135254624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:02Z,use_quota=True,user_id='9fc8761c5dd14189bcf0bbb0429eb352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2f6480-c8f7-4a3f-b6e9-e7c0fbfd8876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c2f6480-c8f7-4a3f-b6e9-e7c0fbfd8876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9082be2d-69d5-464d-90a3-21deba801c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9082be2d-69d5-464d-90a3-21deba801c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed174b1e-6b22-4b85-9f71-732758cb3b38', 'volume_name': 'volume-ed174b1e-6b22-4b85-9f71-732758cb3b38', 'volume_size': 2}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d76798-510d-4f9e-a212-e1790aa14c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d76798-510d-4f9e-a212-e1790aa14c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363e783a-1f54-4854-bc7a-d636820001ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Volume ed174b1e-6b22-4b85-9f71-732758cb3b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed174b1e-6b22-4b85-9f71-732758cb3b38', 'volume_size': 2} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-341880872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed174b1e-6b22-4b85-9f71-732758cb3b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28367c17efc458989d5904135254624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:02Z,use_quota=True,user_id='9fc8761c5dd14189bcf0bbb0429eb352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Creating volume ed174b1e-6b22-4b85-9f71-732758cb3b38 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:02 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 2147483648 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:02 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 2147483648 Nov 06 21:47:02 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:02 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 2147483648" returned: 0 in 0.566s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:03 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 Nov 06 21:47:03 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:03 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38" returned: 0 in 0.293s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363e783a-1f54-4854-bc7a-d636820001ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed174b1e-6b22-4b85-9f71-732758cb3b38', 'volume_size': 2}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac37a51-fac1-4e42-bb25-450e1f4a1b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:03 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Volume volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 (ed174b1e-6b22-4b85-9f71-732758cb3b38): created successfully Nov 06 21:47:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac37a51-fac1-4e42-bb25-450e1f4a1b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Flow 'volume_create_manager' (ea2bac8f-93fb-4d38-ad5d-03a625d7e320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-41325e69-81f6-4e0a-bd12-8676bda6d7ca tempest-VolumesCloneNegativeTest-1246762163 None] Created volume successfully. Nov 06 21:47:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Acquiring lock "cinder-ed174b1e-6b22-4b85-9f71-732758cb3b38-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Lock "cinder-ed174b1e-6b22-4b85-9f71-732758cb3b38-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Acquiring lock "cinder-quobyte-ed174b1e-6b22-4b85-9f71-732758cb3b38" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Lock "cinder-quobyte-ed174b1e-6b22-4b85-9f71-732758cb3b38" acquired by "delete_volume" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:04 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d2ea2-c738-4057-9107-1beb6fab4760]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:04 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 Nov 06 21:47:04 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:05 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38" returned: 0 in 0.418s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:05 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38 Nov 06 21:47:05 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:05 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed174b1e-6b22-4b85-9f71-732758cb3b38" returned: 0 in 0.387s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Lock "cinder-quobyte-ed174b1e-6b22-4b85-9f71-732758cb3b38" released by "delete_volume" :: held 0.875s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Created reservations ['b66f7e0a-cd2e-4d5b-a10f-954fedba0383', '76e24e68-58b8-45b0-bef6-2465e45697fa', '7231e8ea-c5b5-4a5e-a9e0-4574dccaf5d7', '1c0ebd91-c11f-4095-a607-f7dc9a906e92'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:05 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:05 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:05 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.351s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:05 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:05 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Deleted volume successfully. Nov 06 21:47:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfd23f74-f2d3-4cee-a7f4-d15eedd52de0 tempest-VolumesCloneNegativeTest-1246762163 None] Lock "cinder-ed174b1e-6b22-4b85-9f71-732758cb3b38-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Flow 'volume_create_manager' (0948d5b4-f511-4558-9c9c-d6f9b21d1972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe64e0f-badf-4118-92cb-3fb2932067e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe64e0f-badf-4118-92cb-3fb2932067e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-486845842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276353f3-3677-432e-870e-fa575327eb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389d84eda6c048bc93884b5b15bb2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:12Z,use_quota=True,user_id='7f4d6f36ef914eaab2c216539291b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fb981c-a990-484c-94be-53d21dd30bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fb981c-a990-484c-94be-53d21dd30bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebb2180-b8da-41a0-bc67-1f39cb51a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebb2180-b8da-41a0-bc67-1f39cb51a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '276353f3-3677-432e-870e-fa575327eb67', 'volume_name': 'volume-276353f3-3677-432e-870e-fa575327eb67', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e78b741-92ab-48e3-8cc6-eee6416d8a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e78b741-92ab-48e3-8cc6-eee6416d8a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080f04d5-2d63-49b1-9727-c788ed35508f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:13 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Volume 276353f3-3677-432e-870e-fa575327eb67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-276353f3-3677-432e-870e-fa575327eb67', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:47:13 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Trying to clone 276353f3-3677-432e-870e-fa575327eb67 from image 190b0bd5-9057-4553-8deb-2ec752071230 at location (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:47:13 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:47:13 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:47:13 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f0517c-8103-4b49-aa97-8b44494aa384]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:13 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD Nov 06 21:47:13 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Flow 'volume_create_manager' (c92fb48e-eea7-4161-84bb-dfc7eb9e473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5e081e-c787-4074-8e16-2b85ae5d7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d5e081e-c787-4074-8e16-2b85ae5d7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1624057829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5cb0b394d94f4d9c7644a296201f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:14Z,use_quota=True,user_id='dba7caec2763459b92d46dbb2efc35a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e5769a-db58-44f2-8575-e549681d3148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e5769a-db58-44f2-8575-e549681d3148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc079011-02ab-41a0-9cde-6cdc30908025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc079011-02ab-41a0-9cde-6cdc30908025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2', 'volume_name': 'volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:14 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ea2073-1494-481d-87fc-35c7ab2d3347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ea2073-1494-481d-87fc-35c7ab2d3347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf5626c-5cde-4746-81b0-cb7d5ee29fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Volume 8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2', 'volume_size': 1} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1624057829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5cb0b394d94f4d9c7644a296201f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:14Z,use_quota=True,user_id='dba7caec2763459b92d46dbb2efc35a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Creating volume 8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:14 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 is fetched for user 7f4d6f36ef914eaab2c216539291b928. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:47:14 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 1073741824 Nov 06 21:47:14 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff64224-4762-4529-8aec-2d4212817b40]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:14 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD Nov 06 21:47:14 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:15 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 1073741824" returned: 0 in 0.935s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:15 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:15 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 Nov 06 21:47:15 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:15 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2" returned: 0 in 0.561s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-486845842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276353f3-3677-432e-870e-fa575327eb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389d84eda6c048bc93884b5b15bb2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:12Z,use_quota=True,user_id='7f4d6f36ef914eaab2c216539291b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Creating volume 276353f3-3677-432e-870e-fa575327eb67 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:15 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf5626c-5cde-4746-81b0-cb7d5ee29fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6dd981c-64f5-4f48-9d72-cf038812690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:16 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 1073741824 Nov 06 21:47:16 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:16 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Volume volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 (8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2): created successfully Nov 06 21:47:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6dd981c-64f5-4f48-9d72-cf038812690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Flow 'volume_create_manager' (c92fb48e-eea7-4161-84bb-dfc7eb9e473b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-91530fc1-3bf7-4e3c-80ef-b253a3175d1d tempest-AttachVolumeNegativeTest-833279720 None] Created volume successfully. Nov 06 21:47:16 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 1073741824" returned: 0 in 0.868s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:16 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 Nov 06 21:47:16 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:17 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67" returned: 0 in 0.331s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Attempting download of 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume 276353f3-3677-432e-870e-fa575327eb67. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b811c17-29ff-4df9-83e0-778e253f91b1]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_q3ezxaiw {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:17 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_q3ezxaiw Nov 06 21:47:17 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-fe413bb7-252d-47e7-9975-2b89ed9c5439 req-86cc7d6d-1e0f-4a83-b2a2-097cf5a4e215 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-fe413bb7-252d-47e7-9975-2b89ed9c5439 req-86cc7d6d-1e0f-4a83-b2a2-097cf5a4e215 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-fe413bb7-252d-47e7-9975-2b89ed9c5439 req-86cc7d6d-1e0f-4a83-b2a2-097cf5a4e215 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-fe413bb7-252d-47e7-9975-2b89ed9c5439 req-86cc7d6d-1e0f-4a83-b2a2-097cf5a4e215 tempest-AttachVolumeNegativeTest-833279720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b3d05d4-363b-414e-9ca2-7d000eb31114', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:47:17 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-fe413bb7-252d-47e7-9975-2b89ed9c5439 req-86cc7d6d-1e0f-4a83-b2a2-097cf5a4e215 tempest-AttachVolumeNegativeTest-833279720 None] attachment_update completed successfully. Nov 06 21:47:17 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_q3ezxaiw" returned: 0 in 0.548s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_q3ezxaiw {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:18 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_q3ezxaiw Nov 06 21:47:18 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (7d7bb631-638f-42b1-9bc2-a8d1661be12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f650da-63b7-4b68-b228-151939e340fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f650da-63b7-4b68-b228-151939e340fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85062297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede1b99b-e233-4934-bc90-fa1fcc9f1392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:19Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97bce51-cc46-4e7f-ab04-75added6a4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97bce51-cc46-4e7f-ab04-75added6a4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca2292b-c6fa-4a05-9303-8938f778fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca2292b-c6fa-4a05-9303-8938f778fee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ede1b99b-e233-4934-bc90-fa1fcc9f1392', 'volume_name': 'volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4ddc18-33e4-4525-95d5-99a8a1f94873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4ddc18-33e4-4525-95d5-99a8a1f94873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050d4a71-df54-47c1-9ffa-f12ea838d3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:18 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Volume ede1b99b-e233-4934-bc90-fa1fcc9f1392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392', 'volume_size': 1} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-85062297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ede1b99b-e233-4934-bc90-fa1fcc9f1392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:19Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Creating volume ede1b99b-e233-4934-bc90-fa1fcc9f1392 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:18 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:18 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_q3ezxaiw" returned: 1 in 0.933s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_q3ezxaiw' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec287624-b230-44d0-8cd7-998d2328b57e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:18 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 1073741824 Nov 06 21:47:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:18 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:19 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD Nov 06 21:47:19 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:19 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD" returned: 0 in 0.862s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:19 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] 190b0bd5-9057-4553-8deb-2ec752071230 was qcow2, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:47:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:19 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 Nov 06 21:47:19 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:19 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 1073741824" returned: 0 in 1.028s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:19 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 Nov 06 21:47:19 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:20 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392" returned: 0 in 0.459s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050d4a71-df54-47c1-9ffa-f12ea838d3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54576a7-6365-4872-9819-6b888efb4811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:20 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Volume volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 (ede1b99b-e233-4934-bc90-fa1fcc9f1392): created successfully Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54576a7-6365-4872-9819-6b888efb4811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (7d7bb631-638f-42b1-9bc2-a8d1661be12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-16a8e0f5-623d-4d54-b51b-d7d219c4b200 tempest-VolumesActionsTest-367995336 None] Created volume successfully. Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-95ff3029-364a-41be-bf6c-58f484d3ec38 tempest-VolumesActionsTest-367995336 None] Acquiring lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392" by "attach_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-95ff3029-364a-41be-bf6c-58f484d3ec38 tempest-VolumesActionsTest-367995336 None] Lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392" acquired by "attach_volume" :: waited 0.041s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-95ff3029-364a-41be-bf6c-58f484d3ec38 tempest-VolumesActionsTest-367995336 None] Attaching volume ede1b99b-e233-4934-bc90-fa1fcc9f1392 to instance 6c9a2780-4b1b-4432-92ec-3c9e431011b1 at mountpoint /dev/vdb on host None. Nov 06 21:47:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-95ff3029-364a-41be-bf6c-58f484d3ec38 tempest-VolumesActionsTest-367995336 None] Attach volume completed successfully. Nov 06 21:47:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-95ff3029-364a-41be-bf6c-58f484d3ec38 tempest-VolumesActionsTest-367995336 None] Lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392" released by "attach_volume" :: held 0.249s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-93bfee92-3440-48f2-acd4-bf4fbecf496a req-b3a88a3f-130f-4766-bbf2-a6717fe8b387 tempest-AttachVolumeNegativeTest-833279720 None] Terminate volume connection completed successfully. Nov 06 21:47:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-93bfee92-3440-48f2-acd4-bf4fbecf496a req-b3a88a3f-130f-4766-bbf2-a6717fe8b387 tempest-AttachVolumeNegativeTest-833279720 None] Deleting attachment 6b3d05d4-363b-414e-9ca2-7d000eb31114. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:47:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-83a1637a-b37b-4914-9ec7-6bbd97d959d6 tempest-VolumesActionsTest-1273709973 None] Terminate volume connection completed successfully. Nov 06 21:47:22 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67" returned: 0 in 3.036s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:22 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_fajjr95rdevstack@QuobyteHD, size 112.00 MB, duration 3.04 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:47:22 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Converted 112.00 MB image at 36.87 MB/s Nov 06 21:47:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:22 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 1G Nov 06 21:47:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-83a1637a-b37b-4914-9ec7-6bbd97d959d6 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-detach_volume" by "detach_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:22 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-83a1637a-b37b-4914-9ec7-6bbd97d959d6 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-83a1637a-b37b-4914-9ec7-6bbd97d959d6 tempest-VolumesActionsTest-1273709973 None] Detaching volume ede1b99b-e233-4934-bc90-fa1fcc9f1392 from instance 6c9a2780-4b1b-4432-92ec-3c9e431011b1. Nov 06 21:47:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-83a1637a-b37b-4914-9ec7-6bbd97d959d6 tempest-VolumesActionsTest-1273709973 None] Detach volume completed successfully. Nov 06 21:47:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-83a1637a-b37b-4914-9ec7-6bbd97d959d6 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:23 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-22d64d9d-91a7-4798-afbf-96a8cef7ea35 tempest-VolumesActionsTest-367995336 None] Acquiring lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-detach_volume" by "detach_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 1G" returned: 0 in 0.620s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Downloaded image 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume 276353f3-3677-432e-870e-fa575327eb67 successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 for user 7f4d6f36ef914eaab2c216539291b928 is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Marking volume 276353f3-3677-432e-870e-fa575327eb67 as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-22d64d9d-91a7-4798-afbf-96a8cef7ea35 tempest-VolumesActionsTest-367995336 None] Lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-22d64d9d-91a7-4798-afbf-96a8cef7ea35 tempest-VolumesActionsTest-367995336 None] Volume detach called, but volume not attached. Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Copying metadata from image 190b0bd5-9057-4553-8deb-2ec752071230 to 276353f3-3677-432e-870e-fa575327eb67. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Creating volume glance metadata for volume 276353f3-3677-432e-870e-fa575327eb67 backed by image 190b0bd5-9057-4553-8deb-2ec752071230 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-22d64d9d-91a7-4798-afbf-96a8cef7ea35 tempest-VolumesActionsTest-367995336 None] Lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080f04d5-2d63-49b1-9727-c788ed35508f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276353f3-3677-432e-870e-fa575327eb67', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7aa063-fde2-4774-822a-5e5a149cb043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:23 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Volume volume-276353f3-3677-432e-870e-fa575327eb67 (276353f3-3677-432e-870e-fa575327eb67): created successfully Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7aa063-fde2-4774-822a-5e5a149cb043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Flow 'volume_create_manager' (0948d5b4-f511-4558-9c9c-d6f9b21d1972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-574ffe1e-739e-4b7a-80db-824a61c0c215 tempest-VolumesExtendTest-1686668502 None] Created volume successfully. Nov 06 21:47:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Acquiring lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Acquiring lock "cinder-quobyte-ede1b99b-e233-4934-bc90-fa1fcc9f1392" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Lock "cinder-quobyte-ede1b99b-e233-4934-bc90-fa1fcc9f1392" acquired by "delete_volume" :: waited 0.037s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:24 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d8005f-6982-4318-a475-e554b88b0cc5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:24 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 Nov 06 21:47:24 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:24 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392" returned: 0 in 0.691s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:25 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392 Nov 06 21:47:25 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fa20ecc4-8f3b-42bb-8ece-51d3efed09f3 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fa20ecc4-8f3b-42bb-8ece-51d3efed09f3 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad518669-3341-4bc9-ac12-6cbdc16f350a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fa20ecc4-8f3b-42bb-8ece-51d3efed09f3 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:25 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ede1b99b-e233-4934-bc90-fa1fcc9f1392" returned: 0 in 0.467s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Lock "cinder-quobyte-ede1b99b-e233-4934-bc90-fa1fcc9f1392" released by "delete_volume" :: held 1.227s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Created reservations ['c3af2410-c284-4896-8db3-95397b098c77', 'e0c56791-072c-4fa0-b923-4d0ed2744cea', '3e73ef61-1833-445d-bd3b-29540e094332', 'ed92a7ce-ab06-4abc-99c3-a817ff55c5fb'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:25 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 Nov 06 21:47:25 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:25 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:25 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:25 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.376s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:25 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:26 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Deleted volume successfully. Nov 06 21:47:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fa20ecc4-8f3b-42bb-8ece-51d3efed09f3 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67" returned: 0 in 0.666s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fa20ecc4-8f3b-42bb-8ece-51d3efed09f3 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 2G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfc484bd-03ab-4326-a913-8954c295b7de tempest-VolumesActionsTest-367995336 None] Lock "cinder-ede1b99b-e233-4934-bc90-fa1fcc9f1392-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fa20ecc4-8f3b-42bb-8ece-51d3efed09f3 tempest-VolumesExtendTest-1686668502 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 2G" returned: 0 in 0.171s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fa20ecc4-8f3b-42bb-8ece-51d3efed09f3 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.883s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fa20ecc4-8f3b-42bb-8ece-51d3efed09f3 tempest-VolumesExtendTest-1686668502 None] Extend volume completed successfully. Nov 06 21:47:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Acquiring lock "cinder-276353f3-3677-432e-870e-fa575327eb67-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Lock "cinder-276353f3-3677-432e-870e-fa575327eb67-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Acquiring lock "cinder-quobyte-276353f3-3677-432e-870e-fa575327eb67" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Lock "cinder-quobyte-276353f3-3677-432e-870e-fa575327eb67" acquired by "delete_volume" :: waited 0.037s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:27 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34e81d3-0c4a-461a-977f-42de48b4bc32]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:27 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 Nov 06 21:47:27 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:27 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67" returned: 0 in 0.606s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:27 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67 Nov 06 21:47:27 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:28 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-276353f3-3677-432e-870e-fa575327eb67" returned: 0 in 0.298s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Lock "cinder-quobyte-276353f3-3677-432e-870e-fa575327eb67" released by "delete_volume" :: held 0.981s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Created reservations ['0029623a-71eb-4ecb-916c-5cc8073b9a4d', 'a5b1a26f-ab92-456b-9e35-e2da1f03f4da', '7465734d-b112-4fbc-b15a-d7d2d91df991', 'ab051fc4-85a0-48e9-b0c7-9a56e693c9a1'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:28 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:28 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:28 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.315s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Deleted volume successfully. Nov 06 21:47:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c48244d-0be8-4d35-995f-15cad1d9869f tempest-VolumesExtendTest-1686668502 None] Lock "cinder-276353f3-3677-432e-870e-fa575327eb67-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Flow 'volume_create_manager' (b66c214f-2298-4475-b881-9b1dbf4587a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc17763f-b956-4859-8242-9693dbfa9a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc17763f-b956-4859-8242-9693dbfa9a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1583723471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4008dbe-208b-4007-a35d-4231ec49aa61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389d84eda6c048bc93884b5b15bb2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:30Z,use_quota=True,user_id='7f4d6f36ef914eaab2c216539291b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fd7136-fbe6-463f-bcfe-7ad45552bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4fd7136-fbe6-463f-bcfe-7ad45552bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c1c122-c2e0-44be-8382-80032ddc44d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c1c122-c2e0-44be-8382-80032ddc44d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4008dbe-208b-4007-a35d-4231ec49aa61', 'volume_name': 'volume-e4008dbe-208b-4007-a35d-4231ec49aa61', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6555b2c2-60be-4d2d-ae50-a8406475e668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6555b2c2-60be-4d2d-ae50-a8406475e668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad1ef32-ad93-443c-bf52-897e32fbdfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:30 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Volume e4008dbe-208b-4007-a35d-4231ec49aa61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4008dbe-208b-4007-a35d-4231ec49aa61', 'volume_size': 1} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1583723471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4008dbe-208b-4007-a35d-4231ec49aa61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='389d84eda6c048bc93884b5b15bb2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:30Z,use_quota=True,user_id='7f4d6f36ef914eaab2c216539291b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Creating volume e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:30 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:30 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 1073741824 Nov 06 21:47:30 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:30 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 1073741824" returned: 0 in 0.561s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:30 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 Nov 06 21:47:30 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:31 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61" returned: 0 in 0.392s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad1ef32-ad93-443c-bf52-897e32fbdfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4008dbe-208b-4007-a35d-4231ec49aa61', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189f31be-dab9-440b-840e-8150ac850812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Volume volume-e4008dbe-208b-4007-a35d-4231ec49aa61 (e4008dbe-208b-4007-a35d-4231ec49aa61): created successfully Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189f31be-dab9-440b-840e-8150ac850812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Flow 'volume_create_manager' (b66c214f-2298-4475-b881-9b1dbf4587a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:31 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b30686d6-b406-4aef-8b6a-71e8605b2131 tempest-VolumesExtendTest-1686668502 None] Created volume successfully. Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (321ab682-e2c5-4657-a574-c2cdea9d4cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fedda5-82dc-4b67-883a-9146d817acae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8fedda5-82dc-4b67-883a-9146d817acae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1433441305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27d3c33-0ffc-47d3-a246-1293c819cf8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:32Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f430bd-d92f-4071-93a0-b87f1c37c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f430bd-d92f-4071-93a0-b87f1c37c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda8bdac-170c-410e-a345-297ade57cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fda8bdac-170c-410e-a345-297ade57cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27d3c33-0ffc-47d3-a246-1293c819cf8e', 'volume_name': 'volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b24349-a795-4bb9-ba92-8fd310271052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b24349-a795-4bb9-ba92-8fd310271052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd59815-8270-49cc-a24b-0e4e36e128d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Volume b27d3c33-0ffc-47d3-a246-1293c819cf8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e', 'volume_size': 1} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1433441305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27d3c33-0ffc-47d3-a246-1293c819cf8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:32Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Creating volume b27d3c33-0ffc-47d3-a246-1293c819cf8e {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:31 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:31 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e 1073741824 Nov 06 21:47:31 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:32 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e 1073741824" returned: 0 in 0.648s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:32 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e Nov 06 21:47:32 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:32 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e" returned: 0 in 0.290s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.299s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd59815-8270-49cc-a24b-0e4e36e128d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073415a0-0e48-44a7-bafd-c2c01c7356bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Creating offline snapshot 84295dbb-90ca-486d-8d70-f65acf8ad12b of volume e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:47:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Volume volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e (b27d3c33-0ffc-47d3-a246-1293c819cf8e): created successfully Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073415a0-0e48-44a7-bafd-c2c01c7356bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (321ab682-e2c5-4657-a574-c2cdea9d4cba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[becfa062-4e91-4040-a277-2c2ea8e4e806]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c2398770-99ea-40eb-a2b9-4c664edd9094 tempest-VolumesActionsTest-367995336 None] Created volume successfully. Nov 06 21:47:33 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 Nov 06 21:47:33 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:33 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61" returned: 0 in 0.512s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:33 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b 1G Nov 06 21:47:33 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-b27d3c33-0ffc-47d3-a246-1293c819cf8e-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:34 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b 1G" returned: 0 in 0.787s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4008dbe-208b-4007-a35d-4231ec49aa61 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-b27d3c33-0ffc-47d3-a246-1293c819cf8e-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:34 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4008dbe-208b-4007-a35d-4231ec49aa61 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b Nov 06 21:47:34 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-quobyte-b27d3c33-0ffc-47d3-a246-1293c819cf8e" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-quobyte-b27d3c33-0ffc-47d3-a246-1293c819cf8e" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d9f86d-66fa-4ae9-b8ba-f22f88cc9115]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:34 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e Nov 06 21:47:34 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:34 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4008dbe-208b-4007-a35d-4231ec49aa61 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b" returned: 0 in 0.486s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:34 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b is being set with open permissions: ugo+rw Nov 06 21:47:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:34 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b Nov 06 21:47:34 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:35 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e" returned: 0 in 0.597s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:35 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e Nov 06 21:47:35 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:35 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b" returned: 0 in 0.369s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:35 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.info Nov 06 21:47:35 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:35 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b27d3c33-0ffc-47d3-a246-1293c819cf8e" returned: 0 in 0.369s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-quobyte-b27d3c33-0ffc-47d3-a246-1293c819cf8e" released by "delete_volume" :: held 1.096s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Created reservations ['c773760d-237d-4fbf-8832-f4425db26c64', '95927da3-9bd7-4679-8592-a46453616467', 'e4b81641-4796-4d49-bbe3-d78bab55c940', '7771db1d-9c54-4489-835a-0d8a00473069'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:35 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.info" returned: 0 in 0.477s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:35 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.info is being set with open permissions: ugo+rw Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:35 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.info Nov 06 21:47:35 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:35 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:35 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:35 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.info" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.143s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:36 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-370df94c-a839-43ad-858e-208c3b1b09c5 tempest-VolumesExtendTest-1686668502 None] Create snapshot completed successfully Nov 06 21:47:36 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.327s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:36 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:36 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Deleted volume successfully. Nov 06 21:47:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a3a7d014-69b7-4768-a697-290680cea6c8 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-b27d3c33-0ffc-47d3-a246-1293c819cf8e-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a8a69e63-c12f-4bfa-857a-bb69748ce8dc tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a8a69e63-c12f-4bfa-857a-bb69748ce8dc tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8ef1e2-e403-4aa2-a459-7a0637444126]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a8a69e63-c12f-4bfa-857a-bb69748ce8dc tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:37 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 Nov 06 21:47:37 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (05d7a192-fa6c-4d45-9f5a-1a55bba050ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a32a464-6101-4e58-a73a-aa4217ff1aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a32a464-6101-4e58-a73a-aa4217ff1aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-906911431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d47c491-3856-442b-ad89-06f4703c4505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:37Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfe379b-dc1e-4414-87b3-81f7d78f7949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfe379b-dc1e-4414-87b3-81f7d78f7949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8776b984-4be2-4143-9ae4-435250094681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8776b984-4be2-4143-9ae4-435250094681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d47c491-3856-442b-ad89-06f4703c4505', 'volume_name': 'volume-6d47c491-3856-442b-ad89-06f4703c4505', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0a8734-6889-4a12-99f2-de93c4735549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea0a8734-6889-4a12-99f2-de93c4735549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d538554-576c-44a1-a9dd-3a2c324fefac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:37 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Volume 6d47c491-3856-442b-ad89-06f4703c4505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d47c491-3856-442b-ad89-06f4703c4505', 'volume_size': 1} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:37 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a8a69e63-c12f-4bfa-857a-bb69748ce8dc tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61" returned: 0 in 0.477s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a8a69e63-c12f-4bfa-857a-bb69748ce8dc tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b 2G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a8a69e63-c12f-4bfa-857a-bb69748ce8dc tempest-VolumesExtendTest-1686668502 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b 2G" returned: 0 in 0.146s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a8a69e63-c12f-4bfa-857a-bb69748ce8dc tempest-VolumesExtendTest-1686668502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.678s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.253s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-906911431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d47c491-3856-442b-ad89-06f4703c4505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:37Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Creating volume 6d47c491-3856-442b-ad89-06f4703c4505 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:37 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:37 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 1073741824 Nov 06 21:47:37 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a8a69e63-c12f-4bfa-857a-bb69748ce8dc tempest-VolumesExtendTest-1686668502 None] Extend volume completed successfully. Nov 06 21:47:38 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 1073741824" returned: 0 in 0.640s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "cinder-84295dbb-90ca-486d-8d70-f65acf8ad12b-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-84295dbb-90ca-486d-8d70-f65acf8ad12b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "cinder-quobyte-e4008dbe-208b-4007-a35d-4231ec49aa61" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:38 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-quobyte-e4008dbe-208b-4007-a35d-4231ec49aa61" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:38 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "cinder-quobyte-84295dbb-90ca-486d-8d70-f65acf8ad12b" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-quobyte-84295dbb-90ca-486d-8d70-f65acf8ad12b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Deleting offline snapshot 84295dbb-90ca-486d-8d70-f65acf8ad12b of volume e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] snapshot_file for this snap is: volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fed5ae8-ed63-4318-aba3-1558bfbe2974]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:38 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b Nov 06 21:47:38 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:38 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505" returned: 0 in 0.331s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d538554-576c-44a1-a9dd-3a2c324fefac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d47c491-3856-442b-ad89-06f4703c4505', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d15123-938f-44d4-8b50-24bc4eaccb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:38 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Volume volume-6d47c491-3856-442b-ad89-06f4703c4505 (6d47c491-3856-442b-ad89-06f4703c4505): created successfully Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d15123-938f-44d4-8b50-24bc4eaccb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (05d7a192-fa6c-4d45-9f5a-1a55bba050ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b25b72f2-0090-4249-af99-547be0a53f7d tempest-VolumesActionsTest-367995336 None] Created volume successfully. Nov 06 21:47:38 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b" returned: 0 in 0.519s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4008dbe-208b-4007-a35d-4231ec49aa61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca3f476-07d2-4ef2-b408-389dd7ecdebe]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:39 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 Nov 06 21:47:39 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-6d47c491-3856-442b-ad89-06f4703c4505-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:39 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61" returned: 0 in 0.559s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-6d47c491-3856-442b-ad89-06f4703c4505-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:39 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b Nov 06 21:47:39 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-quobyte-6d47c491-3856-442b-ad89-06f4703c4505" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-quobyte-6d47c491-3856-442b-ad89-06f4703c4505" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:39 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8896f-8e94-4737-a737-78b7e0cc9c9d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:39 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 Nov 06 21:47:39 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:40 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b" returned: 0 in 0.765s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:40 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b Nov 06 21:47:40 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:40 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505" returned: 0 in 0.705s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:40 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505 Nov 06 21:47:40 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:40 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61.84295dbb-90ca-486d-8d70-f65acf8ad12b" returned: 0 in 0.537s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:40 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-quobyte-84295dbb-90ca-486d-8d70-f65acf8ad12b" released by "_delete_snapshot" :: held 2.541s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d47c491-3856-442b-ad89-06f4703c4505" returned: 0 in 0.483s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-quobyte-e4008dbe-208b-4007-a35d-4231ec49aa61" released by "delete_snapshot" :: held 2.585s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-quobyte-6d47c491-3856-442b-ad89-06f4703c4505" released by "delete_volume" :: held 1.272s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Created reservations ['f6b84e46-1b07-4fb6-bc25-544fda38cf2a', '9bf9006b-1fed-4c60-8c4e-8787a41e2f2e', '774ca6d2-b20f-4fb6-9cfa-a98ff3d24c41', '25923148-0e13-497e-a016-b010c8fc6f52'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Created reservations ['ce98222d-b140-4e8c-bd93-9350121ae6b0', 'b7453b11-3aa1-42f6-9718-00432823174e', '68a7aeae-8e19-4416-95e0-05b03f009502', '3c92ddae-da01-458b-a24c-ba7f2a1c6496'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:41 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:41 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:41 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Delete snapshot completed successfully. Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-78cb2922-ada5-446e-8394-9bafe11cc5d4 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-84295dbb-90ca-486d-8d70-f65acf8ad12b-delete_snapshot" released by "delete_snapshot" :: held 2.896s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:41 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.304s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:41 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Deleted volume successfully. Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c1bfd807-b18a-4d3f-9b2b-c8245d46a637 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-6d47c491-3856-442b-ad89-06f4703c4505-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "cinder-e4008dbe-208b-4007-a35d-4231ec49aa61-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-e4008dbe-208b-4007-a35d-4231ec49aa61-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "cinder-quobyte-e4008dbe-208b-4007-a35d-4231ec49aa61" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-quobyte-e4008dbe-208b-4007-a35d-4231ec49aa61" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cba8a3-0a93-42d7-9fa1-3bbf42a6c2a9]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:41 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 Nov 06 21:47:41 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:42 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61" returned: 0 in 0.555s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:42 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61 Nov 06 21:47:42 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (9b964b84-bbc1-4efb-aa12-b9eddf271020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc3c68f-5304-46dc-82f6-317198a85dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fc3c68f-5304-46dc-82f6-317198a85dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1584239163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dca2575-6837-4b39-b781-8d76540db5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:43Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a52f4c-3f7d-4cc8-ba00-08fea291684b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a52f4c-3f7d-4cc8-ba00-08fea291684b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55bd86d-2620-4ed9-9ff2-2d8db05c9c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55bd86d-2620-4ed9-9ff2-2d8db05c9c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dca2575-6837-4b39-b781-8d76540db5cb', 'volume_name': 'volume-4dca2575-6837-4b39-b781-8d76540db5cb', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891622c2-dc5c-4ce6-8c3e-4f844a790819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891622c2-dc5c-4ce6-8c3e-4f844a790819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b27e91-9853-400b-8a39-6a039703b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:42 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Volume 4dca2575-6837-4b39-b781-8d76540db5cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dca2575-6837-4b39-b781-8d76540db5cb', 'volume_size': 1} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:42 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1584239163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dca2575-6837-4b39-b781-8d76540db5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:43Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Creating volume 4dca2575-6837-4b39-b781-8d76540db5cb {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:42 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4008dbe-208b-4007-a35d-4231ec49aa61" returned: 0 in 0.441s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:42 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb 1073741824 Nov 06 21:47:42 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-quobyte-e4008dbe-208b-4007-a35d-4231ec49aa61" released by "delete_volume" :: held 1.097s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:42 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Created reservations ['2f63428c-c9b0-4ff0-adb8-475643a9563f', 'bd573276-7a94-4b2f-a70a-3132950a8c5b', '9c4872fb-37e9-4280-8751-d0c1960a81da', '5dbbcb67-4c78-40b6-8241-6ee920ecc455'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:43 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:43 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:43 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.319s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Deleted volume successfully. Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-826e4250-ba4c-45f2-a997-af3f45b87373 tempest-VolumesExtendTest-1686668502 None] Lock "cinder-e4008dbe-208b-4007-a35d-4231ec49aa61-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:43 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb 1073741824" returned: 0 in 0.668s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:43 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb Nov 06 21:47:43 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:43 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb" returned: 0 in 0.329s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b27e91-9853-400b-8a39-6a039703b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dca2575-6837-4b39-b781-8d76540db5cb', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b659358f-74b8-4587-93db-8347422fdb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:43 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Volume volume-4dca2575-6837-4b39-b781-8d76540db5cb (4dca2575-6837-4b39-b781-8d76540db5cb): created successfully Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b659358f-74b8-4587-93db-8347422fdb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (9b964b84-bbc1-4efb-aa12-b9eddf271020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-47728ab1-4c4f-488b-bf19-ee72690d5086 tempest-VolumesActionsTest-367995336 None] Created volume successfully. Nov 06 21:47:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-4dca2575-6837-4b39-b781-8d76540db5cb-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-4dca2575-6837-4b39-b781-8d76540db5cb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-quobyte-4dca2575-6837-4b39-b781-8d76540db5cb" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-quobyte-4dca2575-6837-4b39-b781-8d76540db5cb" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[073168b7-ca78-40b9-af96-83372d280609]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:45 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb Nov 06 21:47:45 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:45 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb" returned: 0 in 0.482s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:45 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb Nov 06 21:47:45 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:45 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4dca2575-6837-4b39-b781-8d76540db5cb" returned: 0 in 0.296s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-quobyte-4dca2575-6837-4b39-b781-8d76540db5cb" released by "delete_volume" :: held 0.838s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:45 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Created reservations ['8aa7a975-ea69-4fbb-903e-836080a36e3c', '6e587c5f-c379-41c6-a54d-462b892d87aa', '4e4acbab-1915-47c6-90dd-42e96e4197da', 'c2a5df9c-8d98-4880-81ed-8bfbb34fd8be'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:46 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:46 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:46 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.645s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Deleted volume successfully. Nov 06 21:47:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-946f6626-8858-4e78-8bb0-fad474c65351 tempest-VolumesActionsTest-1273709973 None] Lock "cinder-4dca2575-6837-4b39-b781-8d76540db5cb-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (28769135-5d41-44d4-b548-c35e8980ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7db437-91f0-464d-ba72-ab7a7f22af35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7db437-91f0-464d-ba72-ab7a7f22af35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1999982838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfef39d1-3d4d-4cad-b06f-9d629b6ce472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:47Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f5325a-f37e-4500-b91c-583bbf8e8b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f5325a-f37e-4500-b91c-583bbf8e8b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdedc72-65b4-489f-8afc-7a97f93d81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdedc72-65b4-489f-8afc-7a97f93d81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfef39d1-3d4d-4cad-b06f-9d629b6ce472', 'volume_name': 'volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d156934-6722-4d08-8687-55ae151e339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d156934-6722-4d08-8687-55ae151e339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c303ecd6-71a2-48dc-99af-ca1db90c64f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:47 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Volume dfef39d1-3d4d-4cad-b06f-9d629b6ce472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472', 'volume_size': 1} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1999982838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfef39d1-3d4d-4cad-b06f-9d629b6ce472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:47Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Creating volume dfef39d1-3d4d-4cad-b06f-9d629b6ce472 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:47 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:47 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 1073741824 Nov 06 21:47:47 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:48 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 1073741824" returned: 0 in 0.957s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:48 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 Nov 06 21:47:48 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:49 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472" returned: 0 in 0.513s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c303ecd6-71a2-48dc-99af-ca1db90c64f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803d4bc8-59ec-4eb8-9902-9e9e2b42f3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:49 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Volume volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 (dfef39d1-3d4d-4cad-b06f-9d629b6ce472): created successfully Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (803d4bc8-59ec-4eb8-9902-9e9e2b42f3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (28769135-5d41-44d4-b548-c35e8980ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5f5388fe-cf1c-41f6-b304-fd436511ae89 tempest-VolumesActionsTest-367995336 None] Created volume successfully. Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-dfef39d1-3d4d-4cad-b06f-9d629b6ce472-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:49 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Lock "cinder-dfef39d1-3d4d-4cad-b06f-9d629b6ce472-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Acquiring lock "cinder-quobyte-dfef39d1-3d4d-4cad-b06f-9d629b6ce472" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Lock "cinder-quobyte-dfef39d1-3d4d-4cad-b06f-9d629b6ce472" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[005218aa-c74e-48fa-a58d-e183855eee48]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:50 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 Nov 06 21:47:50 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:50 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472" returned: 0 in 0.518s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:50 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472 Nov 06 21:47:50 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:50 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dfef39d1-3d4d-4cad-b06f-9d629b6ce472" returned: 0 in 0.306s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Lock "cinder-quobyte-dfef39d1-3d4d-4cad-b06f-9d629b6ce472" released by "delete_volume" :: held 0.941s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Created reservations ['729a745e-f363-4c6f-96e9-73fbff23e829', 'ffb1680f-d0ac-417d-9a7c-db7bd1a6b32b', '7513fef6-8263-4ef7-8872-883ec8bce9ae', '91707cb8-73d3-42a6-8a79-a6e914cebab5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:51 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:51 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:51 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.442s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:51 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Deleted volume successfully. Nov 06 21:47:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c6ccba5b-d837-4505-b9b0-affebf7b07de tempest-VolumesActionsTest-1273709973 None] Lock "cinder-dfef39d1-3d4d-4cad-b06f-9d629b6ce472-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:52 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (a2b1a3dd-222d-43ad-bdca-f8588d70829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca24dea-a96e-49fc-ad54-857fa7704340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca24dea-a96e-49fc-ad54-857fa7704340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1449742627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabdcacf-eded-4551-8438-fe62411776ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:53Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63f5833-d1cc-4656-a93b-07d48ba6ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b63f5833-d1cc-4656-a93b-07d48ba6ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81042fd7-7fe9-42be-b1c8-36af62470dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81042fd7-7fe9-42be-b1c8-36af62470dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cabdcacf-eded-4551-8438-fe62411776ca', 'volume_name': 'volume-cabdcacf-eded-4551-8438-fe62411776ca', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4c8a64-fbc8-4739-9653-8952ec061db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4c8a64-fbc8-4739-9653-8952ec061db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a92b232-67b0-46d2-bf15-77a3fdd24d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Volume cabdcacf-eded-4551-8438-fe62411776ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cabdcacf-eded-4551-8438-fe62411776ca', 'volume_size': 1} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1449742627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabdcacf-eded-4551-8438-fe62411776ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514efd6cf49f435ba181717007571fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:53Z,use_quota=True,user_id='fec6017af1dd4bb59765ab87c1a19d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Creating volume cabdcacf-eded-4551-8438-fe62411776ca {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:53 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:53 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca 1073741824 Nov 06 21:47:53 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:53 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca 1073741824" returned: 0 in 0.666s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:53 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca Nov 06 21:47:53 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:54 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca" returned: 0 in 0.389s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a92b232-67b0-46d2-bf15-77a3fdd24d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabdcacf-eded-4551-8438-fe62411776ca', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae93370-32b7-4179-836e-3f6d78d585eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:54 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Volume volume-cabdcacf-eded-4551-8438-fe62411776ca (cabdcacf-eded-4551-8438-fe62411776ca): created successfully Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae93370-32b7-4179-836e-3f6d78d585eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Flow 'volume_create_manager' (a2b1a3dd-222d-43ad-bdca-f8588d70829a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b811e377-133a-462a-9d18-f44ffe4080cc tempest-VolumesActionsTest-367995336 None] Created volume successfully. Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Flow 'volume_create_manager' (58e8acdd-c3a0-46e7-906d-8f978f1a03e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02566a01-5210-428c-a997-51d6f2594a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02566a01-5210-428c-a997-51d6f2594a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-196659187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9799ace-cb7f-4aa6-b961-74adb329945e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea135590d7345dab43d9fa56115da6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:54Z,use_quota=True,user_id='f4eb56277ff743139698e8410639cda6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235dd1f4-e6db-4f7c-a9f0-0348a891c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235dd1f4-e6db-4f7c-a9f0-0348a891c023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4abaa0d-33d1-4da5-ac48-13535baea14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:54 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:47:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4abaa0d-33d1-4da5-ac48-13535baea14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9799ace-cb7f-4aa6-b961-74adb329945e', 'volume_name': 'volume-b9799ace-cb7f-4aa6-b961-74adb329945e', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08923c4c-93fc-436f-8844-3189f8c25b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08923c4c-93fc-436f-8844-3189f8c25b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:47:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9be159e-8653-4945-ac5c-9ef531be4d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:47:55 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Volume b9799ace-cb7f-4aa6-b961-74adb329945e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9799ace-cb7f-4aa6-b961-74adb329945e', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:47:55 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Trying to clone b9799ace-cb7f-4aa6-b961-74adb329945e from image 190b0bd5-9057-4553-8deb-2ec752071230 at location (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:47:55 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:47:55 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:47:55 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[270cf718-d8b6-497a-9a94-265016cb226b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:55 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD Nov 06 21:47:55 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Acquiring lock "cinder-cabdcacf-eded-4551-8438-fe62411776ca-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Lock "cinder-cabdcacf-eded-4551-8438-fe62411776ca-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Acquiring lock "cinder-quobyte-cabdcacf-eded-4551-8438-fe62411776ca" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Lock "cinder-quobyte-cabdcacf-eded-4551-8438-fe62411776ca" acquired by "delete_volume" :: waited 0.038s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:47:56 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 is fetched for user f4eb56277ff743139698e8410639cda6. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad80df6-b803-4de6-87c3-570132cfff47]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce07cb-cf10-47b1-a3fd-5091985c6e7b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:56 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca Nov 06 21:47:56 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:56 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD Nov 06 21:47:56 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:57 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca" returned: 0 in 0.607s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:57 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca Nov 06 21:47:57 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:57 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD" returned: 0 in 0.540s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-196659187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9799ace-cb7f-4aa6-b961-74adb329945e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea135590d7345dab43d9fa56115da6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:47:54Z,use_quota=True,user_id='f4eb56277ff743139698e8410639cda6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Creating volume b9799ace-cb7f-4aa6-b961-74adb329945e {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:47:57 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:57 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e 1073741824 Nov 06 21:47:57 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:57 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cabdcacf-eded-4551-8438-fe62411776ca" returned: 0 in 0.343s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Lock "cinder-quobyte-cabdcacf-eded-4551-8438-fe62411776ca" released by "delete_volume" :: held 1.140s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=99,cinder:UPDATE=109,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=119,cinder:SELECT=99,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Created reservations ['bf8a2207-5eae-4a08-a259-b4de97888c05', 'ccfe7a01-3052-4fc2-8f9e-cc57f05dfceb', '643b8d11-63f4-41cb-af3f-98891d4dfea9', 'd886c028-da75-4a67-9f5d-4f753c471f52'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:57 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:57 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:57 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e 1073741824" returned: 0 in 0.739s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:57 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.324s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:57 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:57 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Deleted volume successfully. Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9b72f12f-7559-4ebf-9751-ffc4d019d86b tempest-VolumesActionsTest-367995336 None] Lock "cinder-cabdcacf-eded-4551-8438-fe62411776ca-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:47:58 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e Nov 06 21:47:58 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:58 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e" returned: 0 in 0.320s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Attempting download of 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume b9799ace-cb7f-4aa6-b961-74adb329945e. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9747856c-bd72-4548-a9a9-81d0e20f70f4]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_xec8t0dg {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:58 devstack sudo[98885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_xec8t0dg Nov 06 21:47:58 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:58 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:47:58 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:58 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_xec8t0dg" returned: 0 in 0.446s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_xec8t0dg {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:59 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_xec8t0dg Nov 06 21:47:59 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:59 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.479s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:47:59 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_xec8t0dg" returned: 1 in 0.539s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_xec8t0dg' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d063b90f-e88b-410b-b285-e095218a3053]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:47:59 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD Nov 06 21:47:59 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:47:59 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD" returned: 0 in 0.518s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] 190b0bd5-9057-4553-8deb-2ec752071230 was qcow2, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:47:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:00 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e Nov 06 21:48:00 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:02 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e" returned: 0 in 2.626s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:02 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_002tvj11devstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:48:02 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Converted 112.00 MB image at 42.61 MB/s Nov 06 21:48:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:02 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e 1G Nov 06 21:48:02 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:03 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e 1G" returned: 0 in 0.464s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Downloaded image 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume b9799ace-cb7f-4aa6-b961-74adb329945e successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 for user f4eb56277ff743139698e8410639cda6 is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Marking volume b9799ace-cb7f-4aa6-b961-74adb329945e as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Copying metadata from image 190b0bd5-9057-4553-8deb-2ec752071230 to b9799ace-cb7f-4aa6-b961-74adb329945e. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Creating volume glance metadata for volume b9799ace-cb7f-4aa6-b961-74adb329945e backed by image 190b0bd5-9057-4553-8deb-2ec752071230 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9be159e-8653-4945-ac5c-9ef531be4d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9799ace-cb7f-4aa6-b961-74adb329945e', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21772eb-1abb-42a4-8866-2b38b25e7b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:03 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Volume volume-b9799ace-cb7f-4aa6-b961-74adb329945e (b9799ace-cb7f-4aa6-b961-74adb329945e): created successfully Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21772eb-1abb-42a4-8866-2b38b25e7b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Flow 'volume_create_manager' (58e8acdd-c3a0-46e7-906d-8f978f1a03e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6f703f11-2813-4bac-846f-79f5eb4b7bf0 tempest-TestShelveInstance-1749066114 None] Created volume successfully. Nov 06 21:48:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-b1e87acc-326a-4dab-bd5b-94f8abd930f1 req-bbce74ee-aca6-4c07-9f77-0d127a1273bc tempest-TestShelveInstance-1749066114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-b1e87acc-326a-4dab-bd5b-94f8abd930f1 req-bbce74ee-aca6-4c07-9f77-0d127a1273bc tempest-TestShelveInstance-1749066114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-b1e87acc-326a-4dab-bd5b-94f8abd930f1 req-bbce74ee-aca6-4c07-9f77-0d127a1273bc tempest-TestShelveInstance-1749066114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-b1e87acc-326a-4dab-bd5b-94f8abd930f1 req-bbce74ee-aca6-4c07-9f77-0d127a1273bc tempest-TestShelveInstance-1749066114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-b9799ace-cb7f-4aa6-b961-74adb329945e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b547c4a6-8e22-4f46-9311-fafc68eeebb7', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:48:07 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-b1e87acc-326a-4dab-bd5b-94f8abd930f1 req-bbce74ee-aca6-4c07-9f77-0d127a1273bc tempest-TestShelveInstance-1749066114 None] attachment_update completed successfully. Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Flow 'volume_create_manager' (8d4248ca-0c8b-46a6-b963-b7b4e9541dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562d5d6c-0f62-4429-9c39-94c325fcb53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562d5d6c-0f62-4429-9c39-94c325fcb53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1985721488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196c53b8-cb27-420f-b251-3500bcbc9ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5cb0b394d94f4d9c7644a296201f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:16Z,use_quota=True,user_id='dba7caec2763459b92d46dbb2efc35a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34133d9-8a50-41dc-9953-63228fe8dc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34133d9-8a50-41dc-9953-63228fe8dc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa01f67-ba9e-458f-86fe-d578c133689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fa01f67-ba9e-458f-86fe-d578c133689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196c53b8-cb27-420f-b251-3500bcbc9ce6', 'volume_name': 'volume-196c53b8-cb27-420f-b251-3500bcbc9ce6', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d599f3-f1d5-4ed9-8b9f-e266b525d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d599f3-f1d5-4ed9-8b9f-e266b525d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83f5a6a-414b-44b4-b3f5-a84634a07919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:15 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Volume 196c53b8-cb27-420f-b251-3500bcbc9ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196c53b8-cb27-420f-b251-3500bcbc9ce6', 'volume_size': 1} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1985721488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196c53b8-cb27-420f-b251-3500bcbc9ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5cb0b394d94f4d9c7644a296201f60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:16Z,use_quota=True,user_id='dba7caec2763459b92d46dbb2efc35a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Creating volume 196c53b8-cb27-420f-b251-3500bcbc9ce6 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:48:15 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:48:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:16 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 1073741824 Nov 06 21:48:16 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:16 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 1073741824" returned: 0 in 0.635s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:16 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 Nov 06 21:48:16 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:16 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6" returned: 0 in 0.299s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:48:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83f5a6a-414b-44b4-b3f5-a84634a07919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196c53b8-cb27-420f-b251-3500bcbc9ce6', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44450c3f-8351-4309-af91-8f6a8f70bce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:16 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Volume volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 (196c53b8-cb27-420f-b251-3500bcbc9ce6): created successfully Nov 06 21:48:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44450c3f-8351-4309-af91-8f6a8f70bce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Flow 'volume_create_manager' (8d4248ca-0c8b-46a6-b963-b7b4e9541dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:17 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e614488a-f5a9-44fb-b163-952d45e40db0 tempest-AttachVolumeNegativeTest-833279720 None] Created volume successfully. Nov 06 21:48:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-27fe3fa4-19bf-4d18-9dbd-939b23bc004d req-df15463f-46d1-4a44-a183-f0542ecec514 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-27fe3fa4-19bf-4d18-9dbd-939b23bc004d req-df15463f-46d1-4a44-a183-f0542ecec514 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-27fe3fa4-19bf-4d18-9dbd-939b23bc004d req-df15463f-46d1-4a44-a183-f0542ecec514 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-27fe3fa4-19bf-4d18-9dbd-939b23bc004d req-df15463f-46d1-4a44-a183-f0542ecec514 tempest-AttachVolumeNegativeTest-833279720 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-196c53b8-cb27-420f-b251-3500bcbc9ce6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f986610-e5ee-42fb-9b5d-36602b380ca0', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:48:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-27fe3fa4-19bf-4d18-9dbd-939b23bc004d req-df15463f-46d1-4a44-a183-f0542ecec514 tempest-AttachVolumeNegativeTest-833279720 None] attachment_update completed successfully. Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Flow 'volume_create_manager' (eaaa6e63-3e3b-40f8-b5d7-c6b40f48cf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4e58c2-cc0a-412d-b5e5-6e3d7551305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4e58c2-cc0a-412d-b5e5-6e3d7551305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2058138121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fcf21f-1803-4622-a282-06148aa688bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02104fc94d594104823b4984171e6677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:19Z,use_quota=True,user_id='fe6457f74e7542b99fd16b965b87b759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f2486f-a9e6-4439-9c7b-10dbc87b3ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f2486f-a9e6-4439-9c7b-10dbc87b3ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02800e58-eaf4-416e-9858-37b1840e06e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02800e58-eaf4-416e-9858-37b1840e06e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fcf21f-1803-4622-a282-06148aa688bf', 'volume_name': 'volume-67fcf21f-1803-4622-a282-06148aa688bf', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aebdd88-bb3f-4b63-8ee2-8063d3ea3cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aebdd88-bb3f-4b63-8ee2-8063d3ea3cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7181589d-14b7-4bd5-8802-5020b1f1a2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Volume 67fcf21f-1803-4622-a282-06148aa688bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fcf21f-1803-4622-a282-06148aa688bf', 'volume_size': 1} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2058138121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fcf21f-1803-4622-a282-06148aa688bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02104fc94d594104823b4984171e6677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:19Z,use_quota=True,user_id='fe6457f74e7542b99fd16b965b87b759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Creating volume 67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:48:19 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:48:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:19 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf 1073741824 Nov 06 21:48:19 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf 1073741824" returned: 0 in 1.311s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:21 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:21 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf Nov 06 21:48:21 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:21 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf" returned: 0 in 0.572s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:48:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7181589d-14b7-4bd5-8802-5020b1f1a2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fcf21f-1803-4622-a282-06148aa688bf', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bb2ce4-78ab-4da2-ba2a-4c8b471dbe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:21 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Volume volume-67fcf21f-1803-4622-a282-06148aa688bf (67fcf21f-1803-4622-a282-06148aa688bf): created successfully Nov 06 21:48:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bb2ce4-78ab-4da2-ba2a-4c8b471dbe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Flow 'volume_create_manager' (eaaa6e63-3e3b-40f8-b5d7-c6b40f48cf5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d7d7dfbe-f845-44d1-a544-66e989674995 tempest-TestStampPattern-1989377171 None] Created volume successfully. Nov 06 21:48:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-b4b388ec-c7fb-4daa-98a4-b502c211ce7d req-d9cfd268-a0f1-423f-8446-d0f7a76a00cd tempest-AttachVolumeNegativeTest-833279720 None] Terminate volume connection completed successfully. Nov 06 21:48:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-b4b388ec-c7fb-4daa-98a4-b502c211ce7d req-d9cfd268-a0f1-423f-8446-d0f7a76a00cd tempest-AttachVolumeNegativeTest-833279720 None] Deleting attachment 5f986610-e5ee-42fb-9b5d-36602b380ca0. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:48:30 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:48:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (ee37662d-26a3-4474-bb6f-a5a0219909d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9018d103-ea12-4907-a9c0-709da0028cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9018d103-ea12-4907-a9c0-709da0028cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-154980095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99252845-d5f4-4fe9-a609-c221af8a3e7d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:31Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b09d1c8-f4cd-4c50-947a-f886752aec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b09d1c8-f4cd-4c50-947a-f886752aec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408ecf69-b324-42d1-bd91-8d7b42069cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408ecf69-b324-42d1-bd91-8d7b42069cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99252845-d5f4-4fe9-a609-c221af8a3e7d', 'volume_name': 'volume-99252845-d5f4-4fe9-a609-c221af8a3e7d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f230ac5-6541-46eb-80cb-c9065fffb471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f230ac5-6541-46eb-80cb-c9065fffb471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d732c9b-b45a-4507-9c30-04b08621a76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Volume 99252845-d5f4-4fe9-a609-c221af8a3e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99252845-d5f4-4fe9-a609-c221af8a3e7d', 'volume_size': 1} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-154980095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99252845-d5f4-4fe9-a609-c221af8a3e7d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:31Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Creating volume 99252845-d5f4-4fe9-a609-c221af8a3e7d {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:48:31 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:31 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d 1073741824 Nov 06 21:48:31 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:31 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d 1073741824" returned: 0 in 0.752s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:31 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d Nov 06 21:48:31 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:32 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d" returned: 0 in 0.482s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d732c9b-b45a-4507-9c30-04b08621a76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99252845-d5f4-4fe9-a609-c221af8a3e7d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d999f2a9-4fef-4c85-bf94-340c98227675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Volume volume-99252845-d5f4-4fe9-a609-c221af8a3e7d (99252845-d5f4-4fe9-a609-c221af8a3e7d): created successfully Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d999f2a9-4fef-4c85-bf94-340c98227675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (ee37662d-26a3-4474-bb6f-a5a0219909d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fdcbcd33-3976-46de-bd53-fb9c57fbf3a2 tempest-VolumesGetTest-1754234664 None] Created volume successfully. Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "cinder-196c53b8-cb27-420f-b251-3500bcbc9ce6-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-196c53b8-cb27-420f-b251-3500bcbc9ce6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "cinder-quobyte-196c53b8-cb27-420f-b251-3500bcbc9ce6" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-quobyte-196c53b8-cb27-420f-b251-3500bcbc9ce6" acquired by "delete_volume" :: waited 0.060s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1523a1-3ba0-41d1-b372-fdd996a9814b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:33 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 Nov 06 21:48:33 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:34 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6" returned: 0 in 0.862s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:34 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6 Nov 06 21:48:34 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:34 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-196c53b8-cb27-420f-b251-3500bcbc9ce6" returned: 0 in 0.720s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-quobyte-196c53b8-cb27-420f-b251-3500bcbc9ce6" released by "delete_volume" :: held 1.718s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:35 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Created reservations ['ed0589c0-939a-476b-bcac-b6f744e16c6a', '2d59c773-fced-4410-a57d-de7f70f44537', '43c3cb13-7a56-475b-b7d6-679e16e856d5', '12a20c87-53c6-44c5-8274-3f502f8bca49'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:48:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:35 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:48:35 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:35 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:48:35 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (1dbaaa3a-21ac-4fd1-bc03-390f084d7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3537c8c-c788-45d2-a909-769509109a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "cinder-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.683s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:48:36 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Deleted volume successfully. Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3537c8c-c788-45d2-a909-769509109a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1279004385',display_name='tempest-VolumesGetTest-Volume-879945787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9230597b-4546-4b07-8ddf-34b52353576c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:36Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1e0d37-8646-4d2b-a39e-b00648d302f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1e0d37-8646-4d2b-a39e-b00648d302f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf9e17d-f573-4c6f-a0d4-cd5b13058238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf9e17d-f573-4c6f-a0d4-cd5b13058238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9230597b-4546-4b07-8ddf-34b52353576c', 'volume_name': 'volume-9230597b-4546-4b07-8ddf-34b52353576c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1de8206-a31a-4a8c-a4ad-5cdf9f837efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1de8206-a31a-4a8c-a4ad-5cdf9f837efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476ddcfd-3fcb-4465-aa15-459d959d0000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:36 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Volume 9230597b-4546-4b07-8ddf-34b52353576c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9230597b-4546-4b07-8ddf-34b52353576c', 'volume_size': 1} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1279004385',display_name='tempest-VolumesGetTest-Volume-879945787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9230597b-4546-4b07-8ddf-34b52353576c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:36Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Creating volume 9230597b-4546-4b07-8ddf-34b52353576c {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:48:36 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e265c8e-11e8-489b-bc2b-f979e761a3bf tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-196c53b8-cb27-420f-b251-3500bcbc9ce6-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:36 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c 1073741824 Nov 06 21:48:36 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "cinder-quobyte-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-quobyte-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2" acquired by "delete_volume" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9675fa6b-0285-4323-b8bf-2c08dfad2e10]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:36 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 Nov 06 21:48:36 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:36 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2" returned: 0 in 0.543s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:36 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2 Nov 06 21:48:36 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:36 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c 1073741824" returned: 0 in 0.812s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:37 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c Nov 06 21:48:37 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:37 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2" returned: 0 in 0.412s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-quobyte-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2" released by "delete_volume" :: held 1.041s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Created reservations ['f5d87e64-37ab-41ab-b328-c289a7f8cfe9', '8d426f96-62c4-4921-801a-bf7c4c5e32a3', '38346627-e72d-465c-8b68-6eda9994c4e5', '145eefe9-e5f1-47e2-b130-684ac428cdd0'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:48:37 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c" returned: 0 in 0.449s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476ddcfd-3fcb-4465-aa15-459d959d0000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9230597b-4546-4b07-8ddf-34b52353576c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08b6ad8-d5dc-4ed1-835e-201748f8b059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:37 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Volume volume-9230597b-4546-4b07-8ddf-34b52353576c (9230597b-4546-4b07-8ddf-34b52353576c): created successfully Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08b6ad8-d5dc-4ed1-835e-201748f8b059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (1dbaaa3a-21ac-4fd1-bc03-390f084d7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-141c5c11-09b3-460a-b25e-e2db64ca613d tempest-VolumesGetTest-1754234664 None] Created volume successfully. Nov 06 21:48:37 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:48:37 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:38 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.410s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:48:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Deleted volume successfully. Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5c03971d-b4d4-4ae9-a534-cab443255304 tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-8c7b6c93-6822-4e3f-92b8-ff9e95a1ecf2-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-9230597b-4546-4b07-8ddf-34b52353576c-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Lock "cinder-9230597b-4546-4b07-8ddf-34b52353576c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-9230597b-4546-4b07-8ddf-34b52353576c" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-9230597b-4546-4b07-8ddf-34b52353576c" acquired by "delete_volume" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[66856e76-993e-4519-821e-083442d4fdd3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:38 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c Nov 06 21:48:38 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "cinder-fa3c9b14-385d-4213-8775-2a4c9dc20a5a-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-fa3c9b14-385d-4213-8775-2a4c9dc20a5a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "cinder-quobyte-fa3c9b14-385d-4213-8775-2a4c9dc20a5a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-quobyte-fa3c9b14-385d-4213-8775-2a4c9dc20a5a" acquired by "delete_volume" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[734cb21a-b2f9-4b2c-b483-db183a7fa730]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:39 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a Nov 06 21:48:39 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:39 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c" returned: 0 in 0.759s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:39 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c Nov 06 21:48:39 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:39 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a" returned: 0 in 0.620s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:39 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a Nov 06 21:48:39 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:39 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9230597b-4546-4b07-8ddf-34b52353576c" returned: 0 in 0.541s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-9230597b-4546-4b07-8ddf-34b52353576c" released by "delete_volume" :: held 1.416s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Created reservations ['45eeef27-9c8d-42e6-b7ad-418ee16eb006', '5231a542-1e8e-4b85-9061-84290057fbf7', '83b70b73-37ae-4887-bd95-10bcf01fef51', '417cd87c-9835-43e7-bab0-fadc634792d5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:48:39 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-fa3c9b14-385d-4213-8775-2a4c9dc20a5a" returned: 0 in 0.410s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-quobyte-fa3c9b14-385d-4213-8775-2a4c9dc20a5a" released by "delete_volume" :: held 1.121s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:40 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:48:40 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Created reservations ['a501947e-91e0-4c3d-a368-ce6f2ee0ba8e', '9678b02e-f54c-46ec-9493-b5c906655be0', 'c20df616-febb-432d-a196-4fdae06c65e8', '50d04b2d-9a38-4d0a-9cdd-c2e3f69d95cf'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:40 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:48:40 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:40 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.508s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:48:40 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Deleted volume successfully. Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a513d16-5332-4880-8d85-600dbb658758 tempest-VolumesGetTest-1754234664 None] Lock "cinder-9230597b-4546-4b07-8ddf-34b52353576c-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:40 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.403s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:48:40 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Deleted volume successfully. Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6697eb29-ea38-4030-bfd1-5fb4f5310504 tempest-AttachVolumeNegativeTest-833279720 None] Lock "cinder-fa3c9b14-385d-4213-8775-2a4c9dc20a5a-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-99252845-d5f4-4fe9-a609-c221af8a3e7d-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Lock "cinder-99252845-d5f4-4fe9-a609-c221af8a3e7d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-99252845-d5f4-4fe9-a609-c221af8a3e7d" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-99252845-d5f4-4fe9-a609-c221af8a3e7d" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf41fbcc-e117-4a1a-af93-f5189ebcd268]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:41 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d Nov 06 21:48:41 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:41 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d" returned: 0 in 0.585s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:41 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d Nov 06 21:48:41 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:41 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99252845-d5f4-4fe9-a609-c221af8a3e7d" returned: 0 in 0.400s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-99252845-d5f4-4fe9-a609-c221af8a3e7d" released by "delete_volume" :: held 1.092s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Created reservations ['02994b38-9b14-484c-97e5-58e885024d7e', '16694113-e2c6-4272-8b8c-683d5f989be0', 'cb6c95f1-fb5c-4949-8a1c-cf886527b0ce', 'a8b8af06-daa4-4949-ae28-15709d79eb8d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:42 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:48:42 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:42 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.461s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:48:42 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Deleted volume successfully. Nov 06 21:48:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a1edc62c-cfc8-4fab-876b-119406882840 tempest-VolumesGetTest-1754234664 None] Lock "cinder-99252845-d5f4-4fe9-a609-c221af8a3e7d-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (2c8872cc-df70-4769-8a07-ca826fca506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5b524a-3edb-42d7-bcfb-fb172f206ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5b524a-3edb-42d7-bcfb-fb172f206ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-440929913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fed3be-987d-4736-8f2a-607ff753477c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:44Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea16ca1d-5bc3-45c4-bd98-93f531d3a9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea16ca1d-5bc3-45c4-bd98-93f531d3a9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05946e97-754e-4d1d-ba91-bd1f6ab28459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05946e97-754e-4d1d-ba91-bd1f6ab28459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6fed3be-987d-4736-8f2a-607ff753477c', 'volume_name': 'volume-f6fed3be-987d-4736-8f2a-607ff753477c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd106c1-73a6-4192-aaaf-456fc1c08173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd106c1-73a6-4192-aaaf-456fc1c08173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026fd29b-2bc4-4c45-b8c8-bed3335c1591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:43 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Volume f6fed3be-987d-4736-8f2a-607ff753477c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6fed3be-987d-4736-8f2a-607ff753477c', 'volume_size': 1} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-440929913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fed3be-987d-4736-8f2a-607ff753477c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:44Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Creating volume f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:48:43 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:48:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:43 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c 1073741824 Nov 06 21:48:43 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:44 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c 1073741824" returned: 0 in 0.462s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:44 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c Nov 06 21:48:44 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:44 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026fd29b-2bc4-4c45-b8c8-bed3335c1591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fed3be-987d-4736-8f2a-607ff753477c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cf63ee-7ce6-4393-8da3-ddbf09e59494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:44 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Volume volume-f6fed3be-987d-4736-8f2a-607ff753477c (f6fed3be-987d-4736-8f2a-607ff753477c): created successfully Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cf63ee-7ce6-4393-8da3-ddbf09e59494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (2c8872cc-df70-4769-8a07-ca826fca506e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:44 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ed24236a-5eb4-4e9e-9c31-5abc7d3abd9e tempest-VolumesGetTest-1754234664 None] Created volume successfully. Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (bc45180b-4a14-40bf-b6c9-b3c14933a3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9077679-25e0-4ef5-bcf4-66e6ecacbc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9077679-25e0-4ef5-bcf4-66e6ecacbc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1807135532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bc72a8-3915-4fd9-b5ea-859c219a0cf7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f6fed3be-987d-4736-8f2a-607ff753477c,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:46Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c5a679-44fa-4cc5-a72c-85062d2d14ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c5a679-44fa-4cc5-a72c-85062d2d14ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b3edab-05e2-4594-b9e9-d75bcafb6af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b3edab-05e2-4594-b9e9-d75bcafb6af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c9bc72a8-3915-4fd9-b5ea-859c219a0cf7', 'volume_name': 'volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7', 'volume_size': 1, 'source_volid': 'f6fed3be-987d-4736-8f2a-607ff753477c', 'source_volstatus': 'available'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2125f2-e9b5-4a24-a7af-15f63ab2f91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2125f2-e9b5-4a24-a7af-15f63ab2f91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944ebf0e-9e6d-438d-adf8-50d6f8b945e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:46 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Volume c9bc72a8-3915-4fd9-b5ea-859c219a0cf7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7', 'volume_size': 1, 'source_volid': 'f6fed3be-987d-4736-8f2a-607ff753477c', 'source_volstatus': 'available'} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:46 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Cloning volume f6fed3be-987d-4736-8f2a-607ff753477c to volume c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Creating offline snapshot d5fde5a9-47c2-4433-8c7f-48382d62cc2d of volume f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee92c825-b746-4231-82b7-b422b6e0ad67]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:46 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c Nov 06 21:48:46 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:47 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c" returned: 0 in 0.457s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:47 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d 1G Nov 06 21:48:47 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:47 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d 1G" returned: 0 in 0.480s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fed3be-987d-4736-8f2a-607ff753477c -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:47 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fed3be-987d-4736-8f2a-607ff753477c -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d Nov 06 21:48:47 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:48 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6fed3be-987d-4736-8f2a-607ff753477c -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d" returned: 0 in 0.344s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:48 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d is being set with open permissions: ugo+rw Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:48 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d Nov 06 21:48:48 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:48 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d" returned: 0 in 0.303s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:48 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.info Nov 06 21:48:48 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:48 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.info" returned: 0 in 0.290s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:48 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.info is being set with open permissions: ugo+rw Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:48 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.info Nov 06 21:48:48 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:48 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.info" returned: 0 in 0.257s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] snapshot: d5fde5a9-47c2-4433-8c7f-48382d62cc2d, volume: c9bc72a8-3915-4fd9-b5ea-859c219a0cf7, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c195156-2236-4220-9821-bc8405175ea4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:49 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d Nov 06 21:48:49 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:49 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d" returned: 0 in 0.397s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fed3be-987d-4736-8f2a-607ff753477c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b1dc5-3706-4862-afa2-2b79810bd565]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:49 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c Nov 06 21:48:49 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:49 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c" returned: 0 in 0.411s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:48:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:49 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 Nov 06 21:48:49 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-95891553-7eba-4137-bfd7-a2f0156d9a5e tempest-GroupSnapshotsV319Test-2026091514 None] Group tempest-GroupSnapshotsV319Test-Group-1666317636: creating Nov 06 21:48:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-95891553-7eba-4137-bfd7-a2f0156d9a5e tempest-GroupSnapshotsV319Test-2026091514 None] Group tempest-GroupSnapshotsV319Test-Group-1666317636: created successfully Nov 06 21:48:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-95891553-7eba-4137-bfd7-a2f0156d9a5e tempest-GroupSnapshotsV319Test-2026091514 None] Create group completed successfully. Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Flow 'volume_create_manager' (95c22f58-5b19-4e85-adf5-c7a7be3b452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6a0777-ac0b-45e2-930e-1e0a52fed860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6a0777-ac0b-45e2-930e-1e0a52fed860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1900111111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c8179c2-6872-4b34-a08e-bf8ca64d0152,host='devstack@QuobyteHD#QuobyteHD',id=7e0be08c-e633-4e82-b60c-652e61e635d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8746b8118d4e49498646d42eaaf1817a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:54Z,use_quota=True,user_id='238e37fd93c7474f8ada80c0f74b4200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0e1a851-c485-45a7-8531-4b20dd3840e2),volume_type_id=f0e1a851-c485-45a7-8531-4b20dd3840e2)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886a951d-7170-4c7f-bdf0-8aa52282a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (886a951d-7170-4c7f-bdf0-8aa52282a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3688d0c7-3d0e-4795-ac2d-6dd30d3cb5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3688d0c7-3d0e-4795-ac2d-6dd30d3cb5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0be08c-e633-4e82-b60c-652e61e635d7', 'volume_name': 'volume-7e0be08c-e633-4e82-b60c-652e61e635d7', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2e7a7b-28e2-4d69-8cbd-d457ce6115ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2e7a7b-28e2-4d69-8cbd-d457ce6115ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcddcf2-4184-4c7b-95e0-45c968eb8862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:48:54 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Volume 7e0be08c-e633-4e82-b60c-652e61e635d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0be08c-e633-4e82-b60c-652e61e635d7', 'volume_size': 1} Nov 06 21:48:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:58 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" returned: 0 in 8.732s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c, size 1024.00 MB, duration 8.73 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:48:58 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Converted 1024.00 MB image at 117.23 MB/s Nov 06 21:48:58 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 is being set with open permissions: ugo+rw Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:58 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 Nov 06 21:48:58 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:58 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:48:58 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=71,cinder:INSERT=20,cinder:UPDATE=71,cinder:DELETE=9 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:INSERT=24,cinder:UPDATE=73,cinder:SELECT=63,cinder:DELETE=3 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:48:58 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-f365d595-5912-4e41-bcb5-dac00070c486 req-278f2370-c085-466f-baaa-6ac02033629c tempest-TestShelveInstance-1749066114 None] Terminate volume connection completed successfully. Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-f365d595-5912-4e41-bcb5-dac00070c486 req-278f2370-c085-466f-baaa-6ac02033629c tempest-TestShelveInstance-1749066114 None] Deleting attachment b547c4a6-8e22-4f46-9311-fafc68eeebb7. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:48:58 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" returned: 0 in 0.304s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" released by "_copy_volume_from_snapshot" :: held 9.943s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-d5fde5a9-47c2-4433-8c7f-48382d62cc2d" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-d5fde5a9-47c2-4433-8c7f-48382d62cc2d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:48:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Deleting offline snapshot d5fde5a9-47c2-4433-8c7f-48382d62cc2d of volume f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] snapshot_file for this snap is: volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1d4042-bbad-41a7-8a82-2561782faaad]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:59 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:48:59 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d Nov 06 21:48:59 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:48:59 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d" returned: 0 in 0.433s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6fed3be-987d-4736-8f2a-607ff753477c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4f1e55-ed00-4ed4-8c2f-1286ccf5034b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:48:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:48:59 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c Nov 06 21:48:59 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:00 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c" returned: 0 in 0.563s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:00 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d Nov 06 21:49:00 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:00 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d" returned: 0 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:00 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d Nov 06 21:49:00 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:00 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c.d5fde5a9-47c2-4433-8c7f-48382d62cc2d" returned: 0 in 0.262s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-d5fde5a9-47c2-4433-8c7f-48382d62cc2d" released by "_delete_snapshot" :: held 1.730s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.079s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.375s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0c8179c2-6872-4b34-a08e-bf8ca64d0152,created_at=2026-11-06T20:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1900111111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c8179c2-6872-4b34-a08e-bf8ca64d0152,host='devstack@QuobyteHD#QuobyteHD',id=7e0be08c-e633-4e82-b60c-652e61e635d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8746b8118d4e49498646d42eaaf1817a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:48:54Z,use_quota=True,user_id='238e37fd93c7474f8ada80c0f74b4200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0e1a851-c485-45a7-8531-4b20dd3840e2),volume_type_id=f0e1a851-c485-45a7-8531-4b20dd3840e2)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Creating volume 7e0be08c-e633-4e82-b60c-652e61e635d7 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:49:00 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944ebf0e-9e6d-438d-adf8-50d6f8b945e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7', 'volume_size': 1, 'source_volid': 'f6fed3be-987d-4736-8f2a-607ff753477c', 'source_volstatus': 'available'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:00 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 1073741824 Nov 06 21:49:00 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7258bacb-a445-4436-aed0-c71e30d5b444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:00 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Volume volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 (c9bc72a8-3915-4fd9-b5ea-859c219a0cf7): created successfully Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7258bacb-a445-4436-aed0-c71e30d5b444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (bc45180b-4a14-40bf-b6c9-b3c14933a3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:00 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b384b637-2aef-4ce6-be09-0647c67e60ce tempest-VolumesGetTest-1754234664 None] Created volume successfully. Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-4e2fb60a-289c-4370-86d1-ad105443621f req-c48dcf93-57e4-4138-a837-fce30dae2c35 tempest-TestShelveInstance-1749066114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:01 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 1073741824" returned: 0 in 0.660s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:01 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 Nov 06 21:49:01 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:01 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7" returned: 0 in 0.275s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-4e2fb60a-289c-4370-86d1-ad105443621f req-c48dcf93-57e4-4138-a837-fce30dae2c35 tempest-TestShelveInstance-1749066114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.358s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efcddcf2-4184-4c7b-95e0-45c968eb8862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0be08c-e633-4e82-b60c-652e61e635d7', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b011b2db-8846-4a38-818b-9d736ca45c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-4e2fb60a-289c-4370-86d1-ad105443621f req-c48dcf93-57e4-4138-a837-fce30dae2c35 tempest-TestShelveInstance-1749066114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:01 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Volume volume-7e0be08c-e633-4e82-b60c-652e61e635d7 (7e0be08c-e633-4e82-b60c-652e61e635d7): created successfully Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b011b2db-8846-4a38-818b-9d736ca45c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Flow 'volume_create_manager' (95c22f58-5b19-4e85-adf5-c7a7be3b452c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:01 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-291fccbf-8f99-4383-b04f-2ec9f43bab6c tempest-GroupSnapshotsV319Test-2026091514 None] Created volume successfully. Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (165e73b6-4de1-4365-975b-114fc0a57e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab7f4ff-76b4-4a33-aee8-29a3e8b08d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-4e2fb60a-289c-4370-86d1-ad105443621f req-c48dcf93-57e4-4138-a837-fce30dae2c35 tempest-TestShelveInstance-1749066114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-b9799ace-cb7f-4aa6-b961-74adb329945e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79610611-e9a9-44bb-aedf-637f3c4c4c3f', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab7f4ff-76b4-4a33-aee8-29a3e8b08d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1014319986',display_name='tempest-VolumesGetTest-Volume-273646431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ed056-3cec-4bef-b7bd-12c61743c89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:02Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef665a3-bf97-4f76-b9ba-226a5ea46e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef665a3-bf97-4f76-b9ba-226a5ea46e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0414b8-bd76-4ad0-8394-50774f32f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0414b8-bd76-4ad0-8394-50774f32f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a01ed056-3cec-4bef-b7bd-12c61743c89c', 'volume_name': 'volume-a01ed056-3cec-4bef-b7bd-12c61743c89c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f95c2dd-820e-45c2-8ab5-cef1c7d5c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f95c2dd-820e-45c2-8ab5-cef1c7d5c117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af43e0a-1b23-4327-b301-27f209f371e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:01 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Volume a01ed056-3cec-4bef-b7bd-12c61743c89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a01ed056-3cec-4bef-b7bd-12c61743c89c', 'volume_size': 1} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1014319986',display_name='tempest-VolumesGetTest-Volume-273646431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a01ed056-3cec-4bef-b7bd-12c61743c89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:02Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Creating volume a01ed056-3cec-4bef-b7bd-12c61743c89c {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:49:01 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:49:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:01 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c 1073741824 Nov 06 21:49:01 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-4e2fb60a-289c-4370-86d1-ad105443621f req-c48dcf93-57e4-4138-a837-fce30dae2c35 tempest-TestShelveInstance-1749066114 None] attachment_update completed successfully. Nov 06 21:49:02 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c 1073741824" returned: 0 in 0.595s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:02 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c Nov 06 21:49:02 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-94ef9cb5-d49b-4d56-baba-b6c3d1ec018d req-921b510a-50fe-4f0a-b6eb-3304706cd093 tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:02 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c" returned: 0 in 0.304s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-94ef9cb5-d49b-4d56-baba-b6c3d1ec018d req-921b510a-50fe-4f0a-b6eb-3304706cd093 tempest-TestStampPattern-1989377171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.263s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8af43e0a-1b23-4327-b301-27f209f371e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a01ed056-3cec-4bef-b7bd-12c61743c89c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ba6a78-307f-4400-a261-806a489d2d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-94ef9cb5-d49b-4d56-baba-b6c3d1ec018d req-921b510a-50fe-4f0a-b6eb-3304706cd093 tempest-TestStampPattern-1989377171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Volume volume-a01ed056-3cec-4bef-b7bd-12c61743c89c (a01ed056-3cec-4bef-b7bd-12c61743c89c): created successfully Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ba6a78-307f-4400-a261-806a489d2d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (165e73b6-4de1-4365-975b-114fc0a57e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8703523d-6be3-45dc-a72c-dc050de4c255 tempest-VolumesGetTest-1754234664 None] Created volume successfully. Nov 06 21:49:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-94ef9cb5-d49b-4d56-baba-b6c3d1ec018d req-921b510a-50fe-4f0a-b6eb-3304706cd093 tempest-TestStampPattern-1989377171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-67fcf21f-1803-4622-a282-06148aa688bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf037a60-2fcc-4e00-b3a4-dceba778ca6d', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:49:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-94ef9cb5-d49b-4d56-baba-b6c3d1ec018d req-921b510a-50fe-4f0a-b6eb-3304706cd093 tempest-TestStampPattern-1989377171 None] attachment_update completed successfully. Nov 06 21:49:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] GroupSnapshot 93a692ed-3a63-434c-bd70-860c2e5f09c6: creating. Nov 06 21:49:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Group snapshot 93a692ed-3a63-434c-bd70-860c2e5f09c6: creating. {{(pid=87069) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 21:49:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Creating offline snapshot 8aca7cd5-154d-4c10-bde8-ce10e2872476 of volume 7e0be08c-e633-4e82-b60c-652e61e635d7 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:49:03 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd64c5-d1ba-40d3-9335-04fecf7bd868]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:03 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 Nov 06 21:49:03 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:03 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7" returned: 0 in 0.546s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:04 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 1G Nov 06 21:49:04 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-a01ed056-3cec-4bef-b7bd-12c61743c89c-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Lock "cinder-a01ed056-3cec-4bef-b7bd-12c61743c89c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-a01ed056-3cec-4bef-b7bd-12c61743c89c" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-a01ed056-3cec-4bef-b7bd-12c61743c89c" acquired by "delete_volume" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d8df72-88a6-4cdd-9a2e-8b0a4598ef6d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:04 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c Nov 06 21:49:04 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:04 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 1G" returned: 0 in 0.640s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0be08c-e633-4e82-b60c-652e61e635d7 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:04 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0be08c-e633-4e82-b60c-652e61e635d7 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 Nov 06 21:49:04 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:04 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c" returned: 0 in 0.483s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:04 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c Nov 06 21:49:04 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:05 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e0be08c-e633-4e82-b60c-652e61e635d7 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476" returned: 0 in 0.432s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:05 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:05 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 Nov 06 21:49:05 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:05 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a01ed056-3cec-4bef-b7bd-12c61743c89c" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-a01ed056-3cec-4bef-b7bd-12c61743c89c" released by "delete_volume" :: held 0.949s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Created reservations ['6be5d60c-cb47-48bc-bd17-65138d861bd2', '1c64ae35-286e-4c78-ab1c-ef353c247e19', 'e8fa1fd0-3162-45dd-b435-5a78f3209a8f', '3450ae4b-81b0-43bc-b600-e5563c7c2cc4'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:05 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:05 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:05 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476" returned: 0 in 0.674s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:05 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.info Nov 06 21:49:05 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:05 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.408s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:05 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:05 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Deleted volume successfully. Nov 06 21:49:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5bc0da4b-4b88-465f-99e0-5fd414c482ac tempest-VolumesGetTest-1754234664 None] Lock "cinder-a01ed056-3cec-4bef-b7bd-12c61743c89c-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:06 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.info" returned: 0 in 0.544s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:06 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 21:49:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:06 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.info Nov 06 21:49:06 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Lock "cinder-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:06 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.info" returned: 0 in 0.567s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.598s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:07 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff6bea6-a77b-44e7-baf8-e1ae5483f78c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:07 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-74f0ec76-549b-4c10-89d3-a07cb3d4ec1f tempest-GroupSnapshotsV319Test-2026091514 None] group_snapshot 93a692ed-3a63-434c-bd70-860c2e5f09c6: created successfully Nov 06 21:49:07 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 Nov 06 21:49:07 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:07 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" returned: 0 in 0.488s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:07 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7 Nov 06 21:49:07 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:07 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" returned: 0 in 0.422s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7" released by "delete_volume" :: held 0.991s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Created reservations ['1c6ccb1b-eaf3-456c-a6d3-6ae88fc81304', '1a00e8c8-50d6-4a17-9ebf-0aff9d0644ff', 'f6112738-c37e-4793-982c-ff704de4382a', '581c2694-b18c-40b3-ac34-bf9c354c50e5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:08 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:08 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] group_snapshot 93a692ed-3a63-434c-bd70-860c2e5f09c6: deleting Nov 06 21:49:08 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.322s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Deleted volume successfully. Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] group_snapshot 93a692ed-3a63-434c-bd70-860c2e5f09c6: deleting {{(pid=87069) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-172dfe20-e73f-436e-8c4c-081a4853fe5a tempest-VolumesGetTest-1754234664 None] Lock "cinder-c9bc72a8-3915-4fd9-b5ea-859c219a0cf7-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Acquiring lock "cinder-quobyte-7e0be08c-e633-4e82-b60c-652e61e635d7" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Lock "cinder-quobyte-7e0be08c-e633-4e82-b60c-652e61e635d7" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Acquiring lock "cinder-quobyte-8aca7cd5-154d-4c10-bde8-ce10e2872476" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Lock "cinder-quobyte-8aca7cd5-154d-4c10-bde8-ce10e2872476" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Deleting offline snapshot 8aca7cd5-154d-4c10-bde8-ce10e2872476 of volume 7e0be08c-e633-4e82-b60c-652e61e635d7 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] snapshot_file for this snap is: volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd6701d-3702-489a-9003-e598d9a3eaa9]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:08 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 Nov 06 21:49:08 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:09 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476" returned: 0 in 0.476s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e0be08c-e633-4e82-b60c-652e61e635d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-f6fed3be-987d-4736-8f2a-607ff753477c-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f56fd75-ea4f-43c1-aa1d-4025ec13662f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Lock "cinder-f6fed3be-987d-4736-8f2a-607ff753477c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-f6fed3be-987d-4736-8f2a-607ff753477c" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-f6fed3be-987d-4736-8f2a-607ff753477c" acquired by "delete_volume" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1927f1-0e06-4690-b014-11733d190192]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:09 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 Nov 06 21:49:09 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:09 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c Nov 06 21:49:09 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:09 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7" returned: 0 in 0.619s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:09 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 Nov 06 21:49:09 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:10 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c" returned: 0 in 0.503s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:10 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-4059ce80-b005-4c3f-9f10-26aa01fccbe6 req-46d4e23e-d4a0-42f1-b772-d84effc77445 tempest-TestStampPattern-1989377171 None] Terminate volume connection completed successfully. Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-4059ce80-b005-4c3f-9f10-26aa01fccbe6 req-46d4e23e-d4a0-42f1-b772-d84effc77445 tempest-TestStampPattern-1989377171 None] Deleting attachment cf037a60-2fcc-4e00-b3a4-dceba778ca6d. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:49:10 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c Nov 06 21:49:10 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:10 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6fed3be-987d-4736-8f2a-607ff753477c" returned: 0 in 0.368s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:10 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476" returned: 0 in 0.499s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-f6fed3be-987d-4736-8f2a-607ff753477c" released by "delete_volume" :: held 1.016s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:10 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476 Nov 06 21:49:10 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Created reservations ['ab104c2e-3130-4e0e-87fc-798e047f62e6', 'a87c8034-6c1a-4c42-80e9-0ea40209a8e0', 'f1aec4dd-d076-41ee-a692-34dcfef4da1d', 'd19254a6-c10f-4c52-80a4-9811f23d32ae'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:10 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:10 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:10 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7.8aca7cd5-154d-4c10-bde8-ce10e2872476" returned: 0 in 0.392s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Lock "cinder-quobyte-8aca7cd5-154d-4c10-bde8-ce10e2872476" released by "_delete_snapshot" :: held 2.184s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Lock "cinder-quobyte-7e0be08c-e633-4e82-b60c-652e61e635d7" released by "delete_snapshot" :: held 2.231s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:11 devstack cinder-volume[87069]: WARNING cinder.quota [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-471769653 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-471769653, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:49:11 devstack cinder-volume[87069]: WARNING cinder.quota [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-471769653 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-471769653, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:49:11 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.414s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] Created reservations ['6d20392f-9bf3-4b31-8bb1-72ac589e96b4', 'fe745197-83f6-4501-944a-1df0b071140c', '3f1546f1-99d6-4e6a-b4dc-4b6bcc35557e', '7005b1f1-99b0-4d47-a793-f875c6fc81c7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Deleted volume successfully. Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f18b51e2-53e0-4bb2-a4fe-df75e13f1334 tempest-VolumesGetTest-1754234664 None] Lock "cinder-f6fed3be-987d-4736-8f2a-607ff753477c-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Creating offline snapshot 7a89e890-626e-4cb1-9443-79348f0e6c58 of volume 67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:49:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-44a0e449-e776-4a23-9627-0e764b3ac763 tempest-GroupSnapshotsV319Test-2026091514 None] group_snapshot 93a692ed-3a63-434c-bd70-860c2e5f09c6: deleted successfully Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57b88db-a69c-460a-a07d-1b2425350f0a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:11 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf Nov 06 21:49:11 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:11 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf" returned: 0 in 0.488s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:11 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 1G Nov 06 21:49:11 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:12 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 1G" returned: 0 in 0.667s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67fcf21f-1803-4622-a282-06148aa688bf -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:12 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67fcf21f-1803-4622-a282-06148aa688bf -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 Nov 06 21:49:12 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Acquiring lock "cinder-quobyte-7e0be08c-e633-4e82-b60c-652e61e635d7" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Lock "cinder-quobyte-7e0be08c-e633-4e82-b60c-652e61e635d7" acquired by "delete_volume" :: waited 0.075s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8bc3c-3c85-408f-8d38-c506e0c06fb7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (96e4bc23-4065-4777-9f28-75796b9f5ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d667faed-3910-4c94-82d2-567a88515b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d667faed-3910-4c94-82d2-567a88515b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-41686843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745c9f58-c8db-44f5-9f38-999430e2022c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:13Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740efa36-68b6-4bd3-9f5d-55082fd98611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740efa36-68b6-4bd3-9f5d-55082fd98611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c353eff7-685b-4c20-b4eb-78af4e17b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:49:12 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 Nov 06 21:49:12 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:12 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67fcf21f-1803-4622-a282-06148aa688bf -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58" returned: 0 in 0.565s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:12 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 is being set with open permissions: ugo+rw Nov 06 21:49:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:12 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 Nov 06 21:49:12 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:13 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7" returned: 0 in 0.543s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:13 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7 Nov 06 21:49:13 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:13 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58" returned: 0 in 0.433s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:13 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.info Nov 06 21:49:13 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c353eff7-685b-4c20-b4eb-78af4e17b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '745c9f58-c8db-44f5-9f38-999430e2022c', 'volume_name': 'volume-745c9f58-c8db-44f5-9f38-999430e2022c', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c7b42d-0bb4-433f-bad0-ca43d5e80580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c7b42d-0bb4-433f-bad0-ca43d5e80580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b03ad8-d533-4220-a237-c6552b190532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:13 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Volume 745c9f58-c8db-44f5-9f38-999430e2022c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-745c9f58-c8db-44f5-9f38-999430e2022c', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Trying to clone 745c9f58-c8db-44f5-9f38-999430e2022c from image 190b0bd5-9057-4553-8deb-2ec752071230 at location (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:49:13 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7e0be08c-e633-4e82-b60c-652e61e635d7" returned: 0 in 0.360s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Lock "cinder-quobyte-7e0be08c-e633-4e82-b60c-652e61e635d7" released by "delete_volume" :: held 1.053s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:13 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Created reservations ['b83d011e-e47f-461f-8cee-61dfbcd5f8c0'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.info" returned: 0 in 0.497s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:13 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.info is being set with open permissions: ugo+rw Nov 06 21:49:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:13 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.info Nov 06 21:49:13 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:14 devstack cinder-volume[87069]: WARNING cinder.quota [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-471769653 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-471769653, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:49:14 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Created reservations ['87cc5e8b-387b-4cbf-9ab3-08a3339c0ad5', 'c24fd6af-0141-4daf-a60f-30d6453eb61b', '90f155b4-740b-4151-82cd-9afc224efdda', '4a4279b0-acda-4318-b720-149788cbf796'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dff43f8-388e-416e-af7c-cb572912c353]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:14 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.info" returned: 0 in 0.372s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:14 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD Nov 06 21:49:14 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:14 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:14 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.161s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cafb4188-2b00-43fe-9dc1-270c706cd92a tempest-TestStampPattern-1989377171 None] Create snapshot completed successfully Nov 06 21:49:14 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 is fetched for user 7a8c8a462bab461fb8a39083d4289725. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:49:14 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.307s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a49d8d78-f1a0-4298-9f26-9fd4541ea276 tempest-GroupSnapshotsV319Test-2026091514 None] Delete group completed successfully. Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbee1c2-4f87-4971-a366-a0b0be5ae678]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:14 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD Nov 06 21:49:14 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:14 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-41686843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745c9f58-c8db-44f5-9f38-999430e2022c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:13Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Creating volume 745c9f58-c8db-44f5-9f38-999430e2022c {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:49:14 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:49:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:15 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c 1073741824 Nov 06 21:49:15 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:15 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c 1073741824" returned: 0 in 0.532s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:15 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c Nov 06 21:49:15 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:15 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c" returned: 0 in 0.300s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:49:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:15 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Attempting download of 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume 745c9f58-c8db-44f5-9f38-999430e2022c. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:49:15 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdab57b-5967-48bf-8f9e-12a6eea311fa]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_m_sd10a0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:16 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_m_sd10a0 Nov 06 21:49:16 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:16 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_m_sd10a0" returned: 0 in 0.421s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_m_sd10a0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:16 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_m_sd10a0 Nov 06 21:49:16 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:16 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_m_sd10a0" returned: 1 in 0.408s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_m_sd10a0' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:49:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc69756-924d-43b9-996f-21cf470b27a4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:17 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD Nov 06 21:49:17 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:17 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:17 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] 190b0bd5-9057-4553-8deb-2ec752071230 was qcow2, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:49:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:17 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c Nov 06 21:49:17 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:19 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c" returned: 0 in 2.513s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:19 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_5x4idwjddevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:49:19 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Converted 112.00 MB image at 44.53 MB/s Nov 06 21:49:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:20 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c 1G Nov 06 21:49:20 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:20 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c 1G" returned: 0 in 0.517s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Downloaded image 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume 745c9f58-c8db-44f5-9f38-999430e2022c successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 for user 7a8c8a462bab461fb8a39083d4289725 is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Marking volume 745c9f58-c8db-44f5-9f38-999430e2022c as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Copying metadata from image 190b0bd5-9057-4553-8deb-2ec752071230 to 745c9f58-c8db-44f5-9f38-999430e2022c. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Creating volume glance metadata for volume 745c9f58-c8db-44f5-9f38-999430e2022c backed by image 190b0bd5-9057-4553-8deb-2ec752071230 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b03ad8-d533-4220-a237-c6552b190532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745c9f58-c8db-44f5-9f38-999430e2022c', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a1896b-44e0-4e9a-9197-80c381f5f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:20 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Volume volume-745c9f58-c8db-44f5-9f38-999430e2022c (745c9f58-c8db-44f5-9f38-999430e2022c): created successfully Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a1896b-44e0-4e9a-9197-80c381f5f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (96e4bc23-4065-4777-9f28-75796b9f5ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f021acbd-8996-419a-af4b-11360afa674a tempest-VolumesGetTest-1754234664 None] Created volume successfully. Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (dbd81535-db61-442a-a2b2-77d53749674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ec4a8f-e73e-4204-8b09-564ba00dfa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ec4a8f-e73e-4204-8b09-564ba00dfa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1079425035',display_name='tempest-VolumesGetTest-Volume-63878216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:23Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc846298-37b5-41dc-a60b-6e24fee82d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc846298-37b5-41dc-a60b-6e24fee82d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9449cce1-2579-4041-89a7-c669849f8958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9449cce1-2579-4041-89a7-c669849f8958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8', 'volume_name': 'volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63669bc6-3883-4c17-9584-7e356166e805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63669bc6-3883-4c17-9584-7e356166e805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f8a18-03b6-4ea3-a633-159fa5e20e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:22 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Volume 5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8', 'volume_size': 1} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1079425035',display_name='tempest-VolumesGetTest-Volume-63878216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56281e474dc741a1805bd107405b0be7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:23Z,use_quota=True,user_id='7a8c8a462bab461fb8a39083d4289725',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Creating volume 5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:49:22 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:49:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:22 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 1073741824 Nov 06 21:49:22 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:23 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 1073741824" returned: 0 in 0.594s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:23 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 Nov 06 21:49:23 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:23 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (799f8a18-03b6-4ea3-a633-159fa5e20e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda9b769-f24b-423e-9b93-566d8373398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dfd78e8e-cbb6-441a-954d-6808722998e7 tempest-GroupsV320Test-1682911609 None] Group tempest-GroupsV320Test-Group-2139772166: creating Nov 06 21:49:23 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Volume volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 (5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8): created successfully Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda9b769-f24b-423e-9b93-566d8373398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Flow 'volume_create_manager' (dbd81535-db61-442a-a2b2-77d53749674b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e1f42780-9b36-4492-a1a5-225389274ab6 tempest-VolumesGetTest-1754234664 None] Created volume successfully. Nov 06 21:49:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dfd78e8e-cbb6-441a-954d-6808722998e7 tempest-GroupsV320Test-1682911609 None] Group tempest-GroupsV320Test-Group-2139772166: created successfully Nov 06 21:49:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dfd78e8e-cbb6-441a-954d-6808722998e7 tempest-GroupsV320Test-1682911609 None] Create group completed successfully. Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Flow 'volume_create_manager' (d19c8a05-2086-41ab-b347-85db8d2bb268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0fcf62-0d75-4b95-a022-e19485be073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e0fcf62-0d75-4b95-a022-e19485be073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1201141000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d72f148-ac57-4d3f-99c8-64b25088e600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02104fc94d594104823b4984171e6677',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a89e890-626e-4cb1-9443-79348f0e6c58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:25Z,use_quota=True,user_id='fe6457f74e7542b99fd16b965b87b759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefdaaf7-d02c-4994-a045-cbb636b2f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefdaaf7-d02c-4994-a045-cbb636b2f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c56faad-e229-487c-9c9a-4053b94510a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c56faad-e229-487c-9c9a-4053b94510a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d72f148-ac57-4d3f-99c8-64b25088e600', 'volume_name': 'volume-7d72f148-ac57-4d3f-99c8-64b25088e600', 'volume_size': 1, 'snapshot_id': '7a89e890-626e-4cb1-9443-79348f0e6c58'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30517531-0914-4527-80e7-cf7bc1cf6a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30517531-0914-4527-80e7-cf7bc1cf6a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f57b55-d67b-447b-a31f-297636648c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:24 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Volume 7d72f148-ac57-4d3f-99c8-64b25088e600: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d72f148-ac57-4d3f-99c8-64b25088e600', 'volume_size': 1, 'snapshot_id': '7a89e890-626e-4cb1-9443-79348f0e6c58'} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-quobyte-7a89e890-626e-4cb1-9443-79348f0e6c58-7d72f148-ac57-4d3f-99c8-64b25088e600" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Lock "cinder-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-7a89e890-626e-4cb1-9443-79348f0e6c58-7d72f148-ac57-4d3f-99c8-64b25088e600" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Creating volume 7d72f148-ac57-4d3f-99c8-64b25088e600 from snapshot 7a89e890-626e-4cb1-9443-79348f0e6c58 {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-quobyte-7d72f148-ac57-4d3f-99c8-64b25088e600" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-7d72f148-ac57-4d3f-99c8-64b25088e600" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] snapshot: 7a89e890-626e-4cb1-9443-79348f0e6c58, volume: 7d72f148-ac57-4d3f-99c8-64b25088e600, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3aa2c-53d6-49bf-b0fe-5c28e0f194be]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbb564f-3651-459f-81c8-c5542cc34c69]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:25 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 Nov 06 21:49:25 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:25 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 Nov 06 21:49:25 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:25 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58" returned: 0 in 0.439s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67fcf21f-1803-4622-a282-06148aa688bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe71f4b6-7742-496b-b5ef-2e76cfc7dbee]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Created reservations ['8e0a0e2c-bf21-4ac2-846e-4db701d2d8f5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:25 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8" returned: 0 in 0.486s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:25 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8 Nov 06 21:49:25 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:25 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf Nov 06 21:49:25 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:25 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:25 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:25 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8" returned: 0 in 0.324s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8" released by "delete_volume" :: held 0.867s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:26 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf" returned: 0 in 0.438s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:26 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.296s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a26da696-288a-4552-9bd2-6e009b4075fe tempest-GroupsV320Test-1682911609 None] Delete group completed successfully. Nov 06 21:49:26 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 Nov 06 21:49:26 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Created reservations ['2f673c84-0d65-4073-8c4b-e23faa4c8c06', '83fb752d-5a77-4f05-b8d1-47981e71cf1e', '106d1341-2374-4c84-a293-66e084b36ed8', 'ce2b770d-3a62-49fc-902b-6a3182af0002'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:26 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:26 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:26 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.276s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Deleted volume successfully. Nov 06 21:49:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2247f25-de63-45f1-9425-9b8b79be2b8f tempest-VolumesGetTest-1754234664 None] Lock "cinder-5bfdb53c-9e0e-41b2-a1fc-ae292ab10fe8-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-745c9f58-c8db-44f5-9f38-999430e2022c-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Lock "cinder-745c9f58-c8db-44f5-9f38-999430e2022c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Acquiring lock "cinder-quobyte-745c9f58-c8db-44f5-9f38-999430e2022c" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-745c9f58-c8db-44f5-9f38-999430e2022c" acquired by "delete_volume" :: waited 0.054s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:27 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bbd1a1-a5a1-4289-b18e-8a5e3b5aead7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:27 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c Nov 06 21:49:27 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:28 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c" returned: 0 in 0.779s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:28 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c Nov 06 21:49:28 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:29 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-745c9f58-c8db-44f5-9f38-999430e2022c" returned: 0 in 0.690s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Lock "cinder-quobyte-745c9f58-c8db-44f5-9f38-999430e2022c" released by "delete_volume" :: held 1.590s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Created reservations ['6476db75-5760-4dca-85a4-3af1d7d35c41', '1f36ed27-219e-45cb-9263-e4d771480b67', '00404ead-ad49-494e-b9e0-c88a1d9a7fc4', 'fe0f1ca3-5a85-451e-aab4-9907edbb40b7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:29 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:29 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:30 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.770s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:30 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Deleted volume successfully. Nov 06 21:49:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-aab913e4-f0c3-4396-ad80-542f2d6bb846 tempest-VolumesGetTest-1754234664 None] Lock "cinder-745c9f58-c8db-44f5-9f38-999430e2022c-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:36 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600" returned: 0 in 10.244s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:36 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf, size 1024.00 MB, duration 10.25 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:49:36 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Converted 1024.00 MB image at 99.95 MB/s Nov 06 21:49:36 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 is being set with open permissions: ugo+rw Nov 06 21:49:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:36 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 Nov 06 21:49:36 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:36 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600" returned: 0 in 0.649s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-7d72f148-ac57-4d3f-99c8-64b25088e600" released by "_copy_volume_from_snapshot" :: held 11.922s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-7a89e890-626e-4cb1-9443-79348f0e6c58-7d72f148-ac57-4d3f-99c8-64b25088e600" released by "_create_volume_from_snapshot" :: held 12.061s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.087s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f57b55-d67b-447b-a31f-297636648c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d72f148-ac57-4d3f-99c8-64b25088e600', 'volume_size': 1, 'snapshot_id': '7a89e890-626e-4cb1-9443-79348f0e6c58'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84920b4e-6b0c-42b6-95af-7f9110cbfe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:37 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Volume volume-7d72f148-ac57-4d3f-99c8-64b25088e600 (7d72f148-ac57-4d3f-99c8-64b25088e600): created successfully Nov 06 21:49:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84920b4e-6b0c-42b6-95af-7f9110cbfe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Flow 'volume_create_manager' (d19c8a05-2086-41ab-b347-85db8d2bb268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c5671664-7da6-4a55-a7ba-a166a1bf1634 tempest-TestStampPattern-1989377171 None] Created volume successfully. Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Flow 'volume_create_manager' (46b8af6d-1992-4b7a-95f9-83313581e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1a0aaa-98b5-4d4d-93a3-a64b9958eb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1a0aaa-98b5-4d4d-93a3-a64b9958eb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-317972816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc0712d-b21c-4a88-8be9-d8a18ad339df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855496476fd94a75b5c06ae7d3b1f8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:40Z,use_quota=True,user_id='6fe8434c31734e5d9f3593d0fa93c6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7c267d-ad87-47c4-bc09-808bf5ffe100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c7c267d-ad87-47c4-bc09-808bf5ffe100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a145962-b8ab-4804-b6ab-14df3436166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a145962-b8ab-4804-b6ab-14df3436166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc0712d-b21c-4a88-8be9-d8a18ad339df', 'volume_name': 'volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52520c61-8420-4e52-acda-18ea1bc808a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52520c61-8420-4e52-acda-18ea1bc808a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cf4047-2c02-4158-915b-464e039c205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:40 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Volume 9cc0712d-b21c-4a88-8be9-d8a18ad339df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df', 'volume_size': 1} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-317972816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc0712d-b21c-4a88-8be9-d8a18ad339df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='855496476fd94a75b5c06ae7d3b1f8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:40Z,use_quota=True,user_id='6fe8434c31734e5d9f3593d0fa93c6a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Creating volume 9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:49:40 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:49:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:40 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df 1073741824 Nov 06 21:49:40 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:41 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df 1073741824" returned: 0 in 0.639s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:41 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df Nov 06 21:49:41 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:41 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df" returned: 0 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cf4047-2c02-4158-915b-464e039c205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2a68e1-66e8-4960-a7b2-346b56194f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:41 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Volume volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df (9cc0712d-b21c-4a88-8be9-d8a18ad339df): created successfully Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2a68e1-66e8-4960-a7b2-346b56194f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Flow 'volume_create_manager' (46b8af6d-1992-4b7a-95f9-83313581e384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:41 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-878c75a4-2961-431c-8c68-001299d992cc tempest-VolumesSnapshotListTestJSON-1381775701 None] Created volume successfully. Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Flow 'volume_create_manager' (56870cef-4e8d-4ced-982f-bbaa56e023ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7d40b5-7223-4970-9dbe-0ab69dcadf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7d40b5-7223-4970-9dbe-0ab69dcadf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1198280752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6aa385c-280d-432c-b8c4-9bfaac7faa22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1823cd6525cd4a4281490aab06c8b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:42Z,use_quota=True,user_id='524acd0e2b954b94a280f8c1fe4fbd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbc67aa-2541-41ce-b3d7-0a9077b1b62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbc67aa-2541-41ce-b3d7-0a9077b1b62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d177b1-2334-4f9e-ada8-33f6e759843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d177b1-2334-4f9e-ada8-33f6e759843f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6aa385c-280d-432c-b8c4-9bfaac7faa22', 'volume_name': 'volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38433e6b-1866-4352-a8a0-4f911cc9a9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38433e6b-1866-4352-a8a0-4f911cc9a9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18eff92-57ed-49b3-b2b0-910313dbd569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:42 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Volume b6aa385c-280d-432c-b8c4-9bfaac7faa22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22', 'volume_size': 1} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1198280752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6aa385c-280d-432c-b8c4-9bfaac7faa22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1823cd6525cd4a4281490aab06c8b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:42Z,use_quota=True,user_id='524acd0e2b954b94a280f8c1fe4fbd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Creating volume b6aa385c-280d-432c-b8c4-9bfaac7faa22 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:49:42 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:42 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 1073741824 Nov 06 21:49:42 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:43 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 1073741824" returned: 0 in 0.546s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:43 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 Nov 06 21:49:43 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:43 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22" returned: 0 in 0.276s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.865s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18eff92-57ed-49b3-b2b0-910313dbd569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de9e51c-dc5f-4510-8a84-8df68411fef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Creating offline snapshot 5c71de39-9dc7-4daf-9c78-85f0bc364ea8 of volume 9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:49:43 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Volume volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 (b6aa385c-280d-432c-b8c4-9bfaac7faa22): created successfully Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de9e51c-dc5f-4510-8a84-8df68411fef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Flow 'volume_create_manager' (56870cef-4e8d-4ced-982f-bbaa56e023ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5133fe07-3c76-47ae-b6da-42baf31989bf]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-22f45f3d-f827-4bcb-9c4e-fce933e4b4a4 tempest-VolumeQuotasAdminTestJSON-338133714 None] Created volume successfully. Nov 06 21:49:43 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df Nov 06 21:49:43 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:43 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:44 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 1G Nov 06 21:49:44 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:44 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Acquiring lock "cinder-b6aa385c-280d-432c-b8c4-9bfaac7faa22-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 1G" returned: 0 in 0.535s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "cinder-b6aa385c-280d-432c-b8c4-9bfaac7faa22-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:44 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 Nov 06 21:49:44 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Acquiring lock "cinder-quobyte-b6aa385c-280d-432c-b8c4-9bfaac7faa22" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "cinder-quobyte-b6aa385c-280d-432c-b8c4-9bfaac7faa22" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f9dcf4-5505-46aa-838b-d462b5b3445f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:44 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 Nov 06 21:49:44 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:45 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8" returned: 0 in 0.466s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:45 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 is being set with open permissions: ugo+rw Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:45 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 Nov 06 21:49:45 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:45 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22" returned: 0 in 0.516s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:45 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22 Nov 06 21:49:45 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:45 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8" returned: 0 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:45 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.info Nov 06 21:49:45 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:45 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b6aa385c-280d-432c-b8c4-9bfaac7faa22" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "cinder-quobyte-b6aa385c-280d-432c-b8c4-9bfaac7faa22" released by "delete_volume" :: held 0.945s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Created reservations ['98e60080-a491-4124-a8bb-f38b80166014', '0b3ca6fe-65f3-49d9-8fd2-a446f77483f4', '69f39c1d-5925-4a38-a6a7-c2f2c94a5162', '3e96f077-6b79-495e-b474-be2151cf5dba'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:45 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.info" returned: 0 in 0.390s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:45 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.info is being set with open permissions: ugo+rw Nov 06 21:49:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:45 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:45 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:45 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.info Nov 06 21:49:45 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:46 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.info" returned: 0 in 0.336s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:46 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.425s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:46 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9fa9e367-011c-4c6d-941d-c4d2fd59e8a6 tempest-VolumesSnapshotListTestJSON-1381775701 None] Create snapshot completed successfully Nov 06 21:49:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Deleted volume successfully. Nov 06 21:49:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b4f7ed3f-0cb1-4971-a54b-607717edcecc tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "cinder-b6aa385c-280d-432c-b8c4-9bfaac7faa22-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Creating offline snapshot 5707c610-92c6-4d85-95e4-5c387fef5e00 of volume 9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2261bfd2-dbda-4b8e-8b73-5d67e6a45257]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:47 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 Nov 06 21:49:47 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Flow 'volume_create_manager' (8d356b00-72b6-45c3-aac9-f27c3bb35700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15916cb-c422-43fe-87ba-76e741810bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15916cb-c422-43fe-87ba-76e741810bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-495929510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1823cd6525cd4a4281490aab06c8b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:48Z,use_quota=True,user_id='524acd0e2b954b94a280f8c1fe4fbd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bdf439-1056-4d5a-80d9-21dc6f53da96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bdf439-1056-4d5a-80d9-21dc6f53da96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3533be-cd43-43de-bf6f-1352664d3bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3533be-cd43-43de-bf6f-1352664d3bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5', 'volume_name': 'volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f156e36f-f3d9-4846-87f4-f2325f8b8c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f156e36f-f3d9-4846-87f4-f2325f8b8c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5e8339-e688-477b-ac3d-b906fd7f8ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:48 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Volume a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5', 'volume_size': 1} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:48 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8" returned: 0 in 0.584s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:48 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 1G Nov 06 21:49:48 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-951db5c7-3d5d-4f15-a72b-d036a1a26845 tempest-TestShelveInstance-1749066114 None] Terminate volume connection completed successfully. Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-951db5c7-3d5d-4f15-a72b-d036a1a26845 tempest-TestShelveInstance-1749066114 None] Deleting attachment 79610611-e9a9-44bb-aedf-637f3c4c4c3f. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:49:48 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 1G" returned: 0 in 0.698s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:48 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 Nov 06 21:49:48 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Acquiring lock "cinder-b9799ace-cb7f-4aa6-b961-74adb329945e-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Lock "cinder-b9799ace-cb7f-4aa6-b961-74adb329945e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Acquiring lock "cinder-quobyte-b9799ace-cb7f-4aa6-b961-74adb329945e" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Lock "cinder-quobyte-b9799ace-cb7f-4aa6-b961-74adb329945e" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddb9b89-3f8e-4d16-b2af-5878a53c88d7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:49 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e Nov 06 21:49:49 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:49 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:49 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 is being set with open permissions: ugo+rw Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:49 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 Nov 06 21:49:49 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:49 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e" returned: 0 in 0.584s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:49 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00" returned: 0 in 0.455s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:49 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e Nov 06 21:49:49 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.295s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-495929510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1823cd6525cd4a4281490aab06c8b9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:49:48Z,use_quota=True,user_id='524acd0e2b954b94a280f8c1fe4fbd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Creating volume a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:49:49 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1ac13e3c-ca0b-4ebd-92e7-e7912d10d8e2 tempest-VolumesSnapshotListTestJSON-1381775701 None] Create snapshot completed successfully Nov 06 21:49:49 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 1073741824 Nov 06 21:49:49 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:49 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b9799ace-cb7f-4aa6-b961-74adb329945e" returned: 0 in 0.298s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:49 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Lock "cinder-quobyte-b9799ace-cb7f-4aa6-b961-74adb329945e" released by "delete_volume" :: held 0.939s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.quota [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Created reservations ['8ee216da-f354-4b92-ae93-7ff0c778ce65', '9a4bdb77-091e-46d7-a10c-0d79692c7163', 'd305c87a-4df0-4186-9327-0c75db8f98b4', '1072d9f0-a7fd-45fa-9032-001aca6b8428'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:50 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:50 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:50 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 1073741824" returned: 0 in 0.514s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:50 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 Nov 06 21:49:50 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:50 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.286s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.manager [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Deleted volume successfully. Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [req-47c0480d-11ce-4c8b-9146-9248b14d0438 req-8475dfbd-2959-4405-a0f0-199e19d91687 tempest-TestShelveInstance-1749066114 None] Lock "cinder-b9799ace-cb7f-4aa6-b961-74adb329945e-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:50 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5" returned: 0 in 0.278s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d5e8339-e688-477b-ac3d-b906fd7f8ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c258731f-e17f-4699-ac6c-17dd1df831a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:49:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Volume volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 (a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5): created successfully Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c258731f-e17f-4699-ac6c-17dd1df831a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Flow 'volume_create_manager' (8d356b00-72b6-45c3-aac9-f27c3bb35700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:49:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7769269f-a684-4949-b381-fe63020ac25d tempest-VolumeQuotasAdminTestJSON-338133714 None] Created volume successfully. Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Creating offline snapshot d072e3cd-9931-451c-bf33-76e6d73a9389 of volume 9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33079a3-132f-4a13-bbe8-c8aec41c4126]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:51 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 Nov 06 21:49:51 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:51 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00" returned: 0 in 0.593s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:51 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 1G Nov 06 21:49:51 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4d44de12-8cd1-4d67-8318-e3d40d249720 tempest-VolumeQuotasAdminTestJSON-116248926 None] Transfer volume completed successfully. Nov 06 21:49:52 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 1G" returned: 0 in 0.648s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:52 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 Nov 06 21:49:52 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:52 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389" returned: 0 in 0.346s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:52 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 is being set with open permissions: ugo+rw Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:52 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 Nov 06 21:49:52 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Acquiring lock "cinder-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Lock "cinder-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Acquiring lock "cinder-quobyte-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Lock "cinder-quobyte-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb23e13-9cf0-4783-8d21-baf762fd50f3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:52 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389" returned: 0 in 0.257s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:52 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 Nov 06 21:49:52 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cbc80b3c-a30e-40a6-b431-720cee0614ce tempest-VolumesSnapshotListTestJSON-1381775701 None] Create snapshot completed successfully Nov 06 21:49:53 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5" returned: 0 in 0.407s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:53 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5 Nov 06 21:49:53 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:53 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5" returned: 0 in 0.317s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Lock "cinder-quobyte-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5" released by "delete_volume" :: held 0.773s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Created reservations ['0da392fb-faea-436c-b808-7db62eb8c4ec', '245f061c-21cd-4faa-aa92-96e2cbf203e6', 'aa4bac9c-990b-4e95-ad73-25d54161c6a3', 'e853b1b3-9ec0-4456-adda-8340079180a7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:53 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:53 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:53 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.304s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Deleted volume successfully. Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0bf92141-6dd8-49bb-9131-e34d4936f543 tempest-VolumeQuotasAdminTestJSON-1769325781 None] Lock "cinder-a1ae69ad-6e13-4fd7-8fef-bfcf6aa924b5-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-d072e3cd-9931-451c-bf33-76e6d73a9389-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-d072e3cd-9931-451c-bf33-76e6d73a9389-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-quobyte-d072e3cd-9931-451c-bf33-76e6d73a9389" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-d072e3cd-9931-451c-bf33-76e6d73a9389" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Deleting offline snapshot d072e3cd-9931-451c-bf33-76e6d73a9389 of volume 9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] snapshot_file for this snap is: volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6974ec38-4e6c-4713-a670-d33a26f28365]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:54 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 Nov 06 21:49:54 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:54 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389" returned: 0 in 0.442s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[222667be-b7cc-4474-8555-c12dfb445012]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:54 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 Nov 06 21:49:54 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:54 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00" returned: 0 in 0.385s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:54 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 Nov 06 21:49:54 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:55 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389" returned: 0 in 0.502s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:55 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389 Nov 06 21:49:55 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:55 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.d072e3cd-9931-451c-bf33-76e6d73a9389" returned: 0 in 0.329s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-d072e3cd-9931-451c-bf33-76e6d73a9389" released by "_delete_snapshot" :: held 1.776s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" released by "delete_snapshot" :: held 1.805s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:55 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Created reservations ['90e06a59-f006-411d-af0c-47bfc2cc9c58', '29e5e11e-4f2f-4564-a6a4-53782e0c258d', '46e3650c-a427-434a-965e-a35cf472ddb8', '7547acca-4583-432a-964b-a23408a4e08b'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:55 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Delete snapshot completed successfully. Nov 06 21:49:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9c3abbc-9fc3-4c04-82af-8c3985f85031 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-d072e3cd-9931-451c-bf33-76e6d73a9389-delete_snapshot" released by "delete_snapshot" :: held 1.959s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-5707c610-92c6-4d85-95e4-5c387fef5e00-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-5707c610-92c6-4d85-95e4-5c387fef5e00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-quobyte-5707c610-92c6-4d85-95e4-5c387fef5e00" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-5707c610-92c6-4d85-95e4-5c387fef5e00" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Deleting offline snapshot 5707c610-92c6-4d85-95e4-5c387fef5e00 of volume 9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] snapshot_file for this snap is: volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23ed3d9-4bde-4989-8a33-18a7e18fe8cc]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:56 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 Nov 06 21:49:56 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:56 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00" returned: 0 in 0.423s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5de9f31-b7b6-4b8f-a4aa-bfac4dbe1f40]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:56 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 Nov 06 21:49:56 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:57 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8" returned: 0 in 0.428s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:57 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 Nov 06 21:49:57 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:57 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00" returned: 0 in 0.544s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:57 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00 Nov 06 21:49:57 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:57 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5707c610-92c6-4d85-95e4-5c387fef5e00" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-5707c610-92c6-4d85-95e4-5c387fef5e00" released by "_delete_snapshot" :: held 1.816s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" released by "delete_snapshot" :: held 1.842s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Created reservations ['9f91f2b5-ac11-43b7-abac-e847e6690bb2', '29fa2854-8303-4285-b68a-789ea1caf749', '5558991a-9d5a-4388-bb43-d1389fae91f5', 'b7346561-d6cf-4ee4-ac9f-967a76d47830'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:49:58 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Delete snapshot completed successfully. Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-88ad208b-45cd-4ef7-81f9-8fdf1e174919 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-5707c610-92c6-4d85-95e4-5c387fef5e00-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-5c71de39-9dc7-4daf-9c78-85f0bc364ea8-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-5c71de39-9dc7-4daf-9c78-85f0bc364ea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-quobyte-5c71de39-9dc7-4daf-9c78-85f0bc364ea8" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-5c71de39-9dc7-4daf-9c78-85f0bc364ea8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Deleting offline snapshot 5c71de39-9dc7-4daf-9c78-85f0bc364ea8 of volume 9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] snapshot_file for this snap is: volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47e7950-0e92-42fc-a012-45922e0868ce]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:58 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 Nov 06 21:49:58 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:58 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:49:58 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:58 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8" returned: 0 in 0.423s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d5af89-ad9a-482c-9d70-ed72f3abb352]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:59 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:49:59 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df Nov 06 21:49:59 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:59 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df" returned: 0 in 0.503s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:59 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 Nov 06 21:49:59 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:49:59 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8" returned: 0 in 0.389s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:49:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:49:59 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8 Nov 06 21:49:59 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:00 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df.5c71de39-9dc7-4daf-9c78-85f0bc364ea8" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=121,cinder:INSERT=42,cinder:DELETE=11,cinder:SELECT=134 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=148,cinder:SELECT=127,cinder:DELETE=10,cinder:INSERT=33 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-5c71de39-9dc7-4daf-9c78-85f0bc364ea8" released by "_delete_snapshot" :: held 1.769s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" released by "delete_snapshot" :: held 1.810s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Created reservations ['6b3987aa-826b-4b7b-beb4-716761f3d88a', '948b5fb5-b02c-4508-a447-1ad29a5f7c72', 'ab98fffb-d0bc-478f-ac65-4316fab4c9fa', '4cdf7715-3b13-4834-990a-9729aa8333d7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:50:00 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Delete snapshot completed successfully. Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5d480118-5758-426b-b4de-df0a7e17913d tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-5c71de39-9dc7-4daf-9c78-85f0bc364ea8-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-9cc0712d-b21c-4a88-8be9-d8a18ad339df-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-9cc0712d-b21c-4a88-8be9-d8a18ad339df-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[20438ed5-b750-4613-9cb3-3d964297fb31]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:00 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df Nov 06 21:50:00 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:01 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df" returned: 0 in 0.390s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:01 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df Nov 06 21:50:01 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:01 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9cc0712d-b21c-4a88-8be9-d8a18ad339df" returned: 0 in 0.320s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-quobyte-9cc0712d-b21c-4a88-8be9-d8a18ad339df" released by "delete_volume" :: held 0.800s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Created reservations ['2570698c-29a2-4cba-9e72-49db1fefb697', '60d39052-6890-41da-9900-962bb90f3720', 'c7678423-96ac-492f-b990-bc17053d41d1', '4477f4d1-30ef-4074-9b78-c71639e4d8a5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:01 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:50:01 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:01 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.296s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:01 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:50:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Deleted volume successfully. Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-48005895-a6af-4a76-918e-b3d20c9399e3 tempest-VolumesSnapshotListTestJSON-1381775701 None] Lock "cinder-9cc0712d-b21c-4a88-8be9-d8a18ad339df-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Flow 'volume_create_manager' (a1388f0e-b583-4a30-8006-5b367d64be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52886652-61d6-4a90-8c47-d9e57df109f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52886652-61d6-4a90-8c47-d9e57df109f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-638463624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdaa88a-3e32-49ab-a9ba-425571649a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f067104d90348b1837606869cf548f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:02Z,use_quota=True,user_id='14fc12bfaf854b8d8da2f32e5f9b0b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5497d979-8b99-4959-a270-b794bf5b1650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5497d979-8b99-4959-a270-b794bf5b1650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258825cd-6331-48f0-af9a-b35044c59438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258825cd-6331-48f0-af9a-b35044c59438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdaa88a-3e32-49ab-a9ba-425571649a54', 'volume_name': 'volume-8fdaa88a-3e32-49ab-a9ba-425571649a54', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a07d2ea-7962-4f09-90c3-0f1a142805dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a07d2ea-7962-4f09-90c3-0f1a142805dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6cefad-2dc7-49f8-b9a5-4031018d96d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Volume 8fdaa88a-3e32-49ab-a9ba-425571649a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdaa88a-3e32-49ab-a9ba-425571649a54', 'volume_size': 1} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-638463624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdaa88a-3e32-49ab-a9ba-425571649a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f067104d90348b1837606869cf548f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:02Z,use_quota=True,user_id='14fc12bfaf854b8d8da2f32e5f9b0b21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Creating volume 8fdaa88a-3e32-49ab-a9ba-425571649a54 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:50:02 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:50:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:02 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 1073741824 Nov 06 21:50:02 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:03 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 1073741824" returned: 0 in 0.549s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:03 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 Nov 06 21:50:03 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:03 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6cefad-2dc7-49f8-b9a5-4031018d96d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdaa88a-3e32-49ab-a9ba-425571649a54', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f927bb-ef90-4fc3-9119-38c4fb0fb78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:03 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Volume volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 (8fdaa88a-3e32-49ab-a9ba-425571649a54): created successfully Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f927bb-ef90-4fc3-9119-38c4fb0fb78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Flow 'volume_create_manager' (a1388f0e-b583-4a30-8006-5b367d64be7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:50:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9491a2aa-89ec-4630-98ad-3e57adfd5aa7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Created volume successfully. Nov 06 21:50:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Acquiring lock "cinder-8fdaa88a-3e32-49ab-a9ba-425571649a54-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "cinder-8fdaa88a-3e32-49ab-a9ba-425571649a54-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Acquiring lock "cinder-quobyte-8fdaa88a-3e32-49ab-a9ba-425571649a54" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "cinder-quobyte-8fdaa88a-3e32-49ab-a9ba-425571649a54" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:06 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[56212215-c07a-4eb9-8769-1c0e66ad9806]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:06 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 Nov 06 21:50:06 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:06 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54" returned: 0 in 0.426s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:06 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54 Nov 06 21:50:06 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:07 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-8fdaa88a-3e32-49ab-a9ba-425571649a54" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "cinder-quobyte-8fdaa88a-3e32-49ab-a9ba-425571649a54" released by "delete_volume" :: held 0.779s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Created reservations ['5d271f88-9917-4cb3-b14b-e64a27b29a5f', 'b648675a-bae2-4ce7-814e-4f3ba09638cb', '51787c8b-7f55-43e3-9d65-574a977e3654', '2fd4363b-ffb0-46a8-84c9-e8a617ea63c2'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:07 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:50:07 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:07 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.282s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:50:07 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Deleted volume successfully. Nov 06 21:50:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-126213d4-112b-4de0-881a-923f9adfb2a7 tempest-VolumeQuotasNegativeTestJSON-1559066527 None] Lock "cinder-8fdaa88a-3e32-49ab-a9ba-425571649a54-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:17 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:50:17 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:50:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-eaee3011-03d8-42d3-83b0-7165f54d8975 req-af96019e-9146-495f-9514-74c5f0ddfb2c tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-eaee3011-03d8-42d3-83b0-7165f54d8975 req-af96019e-9146-495f-9514-74c5f0ddfb2c tempest-TestStampPattern-1989377171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-eaee3011-03d8-42d3-83b0-7165f54d8975 req-af96019e-9146-495f-9514-74c5f0ddfb2c tempest-TestStampPattern-1989377171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-eaee3011-03d8-42d3-83b0-7165f54d8975 req-af96019e-9146-495f-9514-74c5f0ddfb2c tempest-TestStampPattern-1989377171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-7d72f148-ac57-4d3f-99c8-64b25088e600', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a5d85d0-452a-42e4-a619-4a5fad5ba784', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:50:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-eaee3011-03d8-42d3-83b0-7165f54d8975 req-af96019e-9146-495f-9514-74c5f0ddfb2c tempest-TestStampPattern-1989377171 None] attachment_update completed successfully. Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Flow 'volume_create_manager' (8937fd6c-202e-4fec-bd86-cf16d62a75d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd8c3e7-6eef-43cf-9b11-0589d975cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd8c3e7-6eef-43cf-9b11-0589d975cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1049473962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb98ce3-fd86-4a77-9218-2cfa6a80b47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bb879d047a42e3a1d7631f05b23386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:23Z,use_quota=True,user_id='0f84923d02c649a7b6562ea91943f57b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d240efd2-03b4-4088-b45a-451484a4bfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d240efd2-03b4-4088-b45a-451484a4bfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beeb3a18-40dd-4d2f-9ae8-14e440e42e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beeb3a18-40dd-4d2f-9ae8-14e440e42e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb98ce3-fd86-4a77-9218-2cfa6a80b47d', 'volume_name': 'volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cc9a9f-dee8-4cd7-a7d9-f81282e4c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cc9a9f-dee8-4cd7-a7d9-f81282e4c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa975fcc-e472-49b7-906a-dd739f207495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:22 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Volume ecb98ce3-fd86-4a77-9218-2cfa6a80b47d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d', 'volume_size': 1} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1049473962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb98ce3-fd86-4a77-9218-2cfa6a80b47d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79bb879d047a42e3a1d7631f05b23386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:23Z,use_quota=True,user_id='0f84923d02c649a7b6562ea91943f57b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Creating volume ecb98ce3-fd86-4a77-9218-2cfa6a80b47d {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:50:22 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:50:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:22 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d 1073741824 Nov 06 21:50:22 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:23 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d 1073741824" returned: 0 in 0.636s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:23 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d Nov 06 21:50:23 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:23 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d" returned: 0 in 0.447s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:50:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa975fcc-e472-49b7-906a-dd739f207495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f806e4e-ff46-4bfc-8113-55f3154cbbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:23 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Volume volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d (ecb98ce3-fd86-4a77-9218-2cfa6a80b47d): created successfully Nov 06 21:50:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f806e4e-ff46-4bfc-8113-55f3154cbbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Flow 'volume_create_manager' (8937fd6c-202e-4fec-bd86-cf16d62a75d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:50:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-98902658-aeb2-44ed-ab55-8b7b300ef1dd tempest-VolumesServicesTestJSON-1667000527 None] Created volume successfully. Nov 06 21:50:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-28f56157-5015-4cfe-b649-1d63118c9a96 req-8db17199-22e9-4445-8d0f-cd5e8ef772ad tempest-TestStampPattern-1989377171 None] Terminate volume connection completed successfully. Nov 06 21:50:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-28f56157-5015-4cfe-b649-1d63118c9a96 req-8db17199-22e9-4445-8d0f-cd5e8ef772ad tempest-TestStampPattern-1989377171 None] Deleting attachment 5a5d85d0-452a-42e4-a619-4a5fad5ba784. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:50:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Acquiring lock "cinder-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Lock "cinder-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Acquiring lock "cinder-quobyte-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Lock "cinder-quobyte-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f08a8e-9729-40a4-b373-13e1f7ce6a8a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:25 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d Nov 06 21:50:25 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:25 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d" returned: 0 in 0.425s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:25 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d Nov 06 21:50:25 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:25 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d" returned: 0 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Lock "cinder-quobyte-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d" released by "delete_volume" :: held 0.832s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Created reservations ['6b65b970-060e-4755-a72f-37dd9bb627d5', 'da5e2ba1-a2a8-416c-93b9-700c8d459366', 'bac30e35-874b-4d58-b667-d327dfc5ced9', '6f7a04db-6a7b-41b6-a95d-a3e9d80eed32'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:26 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:50:26 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:26 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.455s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:50:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Deleted volume successfully. Nov 06 21:50:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dc21f415-f6ed-4e3c-bbd7-e92d848b6f41 tempest-VolumesServicesTestJSON-1667000527 None] Lock "cinder-ecb98ce3-fd86-4a77-9218-2cfa6a80b47d-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-7d72f148-ac57-4d3f-99c8-64b25088e600-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Lock "cinder-7d72f148-ac57-4d3f-99c8-64b25088e600-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-quobyte-7d72f148-ac57-4d3f-99c8-64b25088e600" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-7d72f148-ac57-4d3f-99c8-64b25088e600" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[805be787-0828-4646-ae9f-edf8af75ea21]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:34 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 Nov 06 21:50:34 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:34 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600" returned: 0 in 0.466s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:34 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600 Nov 06 21:50:34 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:34 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d72f148-ac57-4d3f-99c8-64b25088e600" returned: 0 in 0.347s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-7d72f148-ac57-4d3f-99c8-64b25088e600" released by "delete_volume" :: held 0.885s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Created reservations ['96fab136-8405-4b65-bdc5-38e4f4ea623c', '22710a25-f7a3-4fe7-b297-7134910a0580', 'c2073c2b-431d-4f89-90a0-7f3994af9746', 'c80b8ccc-fc7a-4615-8d0e-dbff0cc69f41'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:34 devstack sudo[101695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:50:34 devstack sudo[101695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:35 devstack sudo[101695]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.369s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:50:35 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Deleted volume successfully. Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5f3d0ef3-4426-44ea-84bf-274904604994 tempest-TestStampPattern-1989377171 None] Lock "cinder-7d72f148-ac57-4d3f-99c8-64b25088e600-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-7a89e890-626e-4cb1-9443-79348f0e6c58-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Lock "cinder-7a89e890-626e-4cb1-9443-79348f0e6c58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-quobyte-67fcf21f-1803-4622-a282-06148aa688bf" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-67fcf21f-1803-4622-a282-06148aa688bf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-quobyte-7a89e890-626e-4cb1-9443-79348f0e6c58" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-7a89e890-626e-4cb1-9443-79348f0e6c58" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Deleting offline snapshot 7a89e890-626e-4cb1-9443-79348f0e6c58 of volume 67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] snapshot_file for this snap is: volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a0569e-102a-4ade-9019-0993d68446ad]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:35 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 Nov 06 21:50:35 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:36 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58" returned: 0 in 0.602s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67fcf21f-1803-4622-a282-06148aa688bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:50:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0097c68f-4b23-43f1-a8a0-2a820d294e6f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:36 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf Nov 06 21:50:36 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:37 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf" returned: 0 in 0.878s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:37 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 Nov 06 21:50:37 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:37 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58" returned: 0 in 0.611s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:37 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58 Nov 06 21:50:37 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:38 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf.7a89e890-626e-4cb1-9443-79348f0e6c58" returned: 0 in 0.780s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-7a89e890-626e-4cb1-9443-79348f0e6c58" released by "_delete_snapshot" :: held 3.068s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-67fcf21f-1803-4622-a282-06148aa688bf" released by "delete_snapshot" :: held 3.112s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:38 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Created reservations ['0982dac7-8f59-458e-bd77-7b2fdbbc712d', 'eeb9363a-4b63-411c-ad19-323b986dce5b', 'fac00603-c78c-4952-9259-d5511407b316', '0e9746f2-6593-4bdd-a5c0-c537f6d8ca04'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:50:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Delete snapshot completed successfully. Nov 06 21:50:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-484e82fc-8c4f-432e-a2a8-42251dbfbbf2 tempest-TestStampPattern-1989377171 None] Lock "cinder-7a89e890-626e-4cb1-9443-79348f0e6c58-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Flow 'volume_create_manager' (f0ce6bf5-6453-4a19-95be-aedb04251e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d601a657-9fa1-4ae9-8a74-118a60079dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d601a657-9fa1-4ae9-8a74-118a60079dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-837644996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590232fd-80e1-4773-affd-59f69a8c87b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99562926848147b39820f27d04709107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:43Z,use_quota=True,user_id='5c0626943d7e49b29215a8ca9130eda6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8dd9c94-998d-42e1-a8b2-7cb2949fe714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8dd9c94-998d-42e1-a8b2-7cb2949fe714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acd30b2-3275-4420-91fb-cce638500340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acd30b2-3275-4420-91fb-cce638500340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590232fd-80e1-4773-affd-59f69a8c87b8', 'volume_name': 'volume-590232fd-80e1-4773-affd-59f69a8c87b8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0bcc70-da24-4ef1-a433-793572f79462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0bcc70-da24-4ef1-a433-793572f79462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d114657-35a4-42a4-bca1-e44d807d2bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:42 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Volume 590232fd-80e1-4773-affd-59f69a8c87b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590232fd-80e1-4773-affd-59f69a8c87b8', 'volume_size': 1} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-837644996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590232fd-80e1-4773-affd-59f69a8c87b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99562926848147b39820f27d04709107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:43Z,use_quota=True,user_id='5c0626943d7e49b29215a8ca9130eda6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Creating volume 590232fd-80e1-4773-affd-59f69a8c87b8 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:50:42 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:50:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:42 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 1073741824 Nov 06 21:50:42 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:43 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 1073741824" returned: 0 in 0.618s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:43 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 Nov 06 21:50:43 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:44 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8" returned: 0 in 0.629s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:50:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d114657-35a4-42a4-bca1-e44d807d2bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590232fd-80e1-4773-affd-59f69a8c87b8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f9f62c-dd41-4bea-a72e-3eebc0261e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:44 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Volume volume-590232fd-80e1-4773-affd-59f69a8c87b8 (590232fd-80e1-4773-affd-59f69a8c87b8): created successfully Nov 06 21:50:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f9f62c-dd41-4bea-a72e-3eebc0261e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Flow 'volume_create_manager' (f0ce6bf5-6453-4a19-95be-aedb04251e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:50:44 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-50a2fbca-0676-4219-a7df-0a84a31cca13 tempest-TestImageHashVerification-1727496113 None] Created volume successfully. Nov 06 21:50:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:46 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[036f089d-bbab-44ee-9df7-8e6c5a98a55d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:46 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 Nov 06 21:50:46 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-67fcf21f-1803-4622-a282-06148aa688bf-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Lock "cinder-67fcf21f-1803-4622-a282-06148aa688bf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Acquiring lock "cinder-quobyte-67fcf21f-1803-4622-a282-06148aa688bf" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-67fcf21f-1803-4622-a282-06148aa688bf" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:50:47 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8" returned: 0 in 0.551s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d4be0-8bc0-46f6-93ac-5909335c7881]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[629fc069-5e33-434c-bf88-217a06fe2e44]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:47 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 Nov 06 21:50:47 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:47 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf Nov 06 21:50:47 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:47 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8" returned: 0 in 0.554s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 /opt/stack/data/cinder/conversion/590232fd-80e1-4773-affd-59f69a8c87b8.temp_image.b1c932c0-cded-48cf-a89e-afd30e2e29edttrpviyk.img {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:47 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf" returned: 0 in 0.596s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:47 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 /opt/stack/data/cinder/conversion/590232fd-80e1-4773-affd-59f69a8c87b8.temp_image.b1c932c0-cded-48cf-a89e-afd30e2e29edttrpviyk.img Nov 06 21:50:47 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:47 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf Nov 06 21:50:47 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:48 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-67fcf21f-1803-4622-a282-06148aa688bf" returned: 0 in 0.443s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Lock "cinder-quobyte-67fcf21f-1803-4622-a282-06148aa688bf" released by "delete_volume" :: held 1.163s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Created reservations ['8acdd530-030a-41c2-80e4-fd6feb250045', '09c7c128-921c-4ff5-9669-59c103d4b857', 'f5273a23-0bb6-4dc6-b17f-5da2f031af12', 'dabcdab1-66cf-402f-90ff-b11ca36600f6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:49 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:50:49 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:49 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.828s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:49 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:50:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Deleted volume successfully. Nov 06 21:50:49 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d1018cb-f3fb-4afe-b900-d8b51a5a4d45 tempest-TestStampPattern-1989377171 None] Lock "cinder-67fcf21f-1803-4622-a282-06148aa688bf-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Flow 'volume_create_manager' (8bf20df3-b392-4474-b66d-56cc85e8be5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4829ba62-0de2-48a7-a870-72dd78d3c559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4829ba62-0de2-48a7-a870-72dd78d3c559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-76071606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c9e10b-255b-4525-8524-1d88c7e3d2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d315d7548074ded893be0a47d57c7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:51Z,use_quota=True,user_id='05ef0da7d3de4bbe84029f969757f6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7ef09d-0309-4f5d-a26f-a3ae767304cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d7ef09d-0309-4f5d-a26f-a3ae767304cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703bd20b-1c73-48c7-906c-dba79a205fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (703bd20b-1c73-48c7-906c-dba79a205fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c9e10b-255b-4525-8524-1d88c7e3d2a3', 'volume_name': 'volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293739d0-d3dc-49f4-b1b4-ed3b0cb130ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293739d0-d3dc-49f4-b1b4-ed3b0cb130ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51798ab-8154-4c84-97ff-7fd1fe1345d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:51 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Volume f6c9e10b-255b-4525-8524-1d88c7e3d2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3', 'volume_size': 1} Nov 06 21:50:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:52 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:50:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Flow 'volume_create_manager' (f99517ef-2c5b-455a-a1db-c2d1b3a9ecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:50:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b30d0df-f567-4c35-a40b-ceca1429a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b30d0df-f567-4c35-a40b-ceca1429a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-411356032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bd7ebe-9ced-4267-a694-1ff8388b58b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dae51dc1d0a4a4cacaeff14c1b73e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:53Z,use_quota=True,user_id='13273694bd7d46e5aac05c101fec77ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dda6ae8-4511-46a9-874a-026641c0d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dda6ae8-4511-46a9-874a-026641c0d48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42aeeff2-99d1-4420-97aa-32c07b76e751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42aeeff2-99d1-4420-97aa-32c07b76e751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bd7ebe-9ced-4267-a694-1ff8388b58b8', 'volume_name': 'volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae22466-2e1a-4659-9980-a2c42523139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae22466-2e1a-4659-9980-a2c42523139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:50:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fc2ca4-b7b3-4438-aaef-33bd9475ba23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:50:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Volume 16bd7ebe-9ced-4267-a694-1ff8388b58b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8', 'volume_size': 1} Nov 06 21:50:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:58 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:50:58 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:58 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 /opt/stack/data/cinder/conversion/590232fd-80e1-4773-affd-59f69a8c87b8.temp_image.b1c932c0-cded-48cf-a89e-afd30e2e29edttrpviyk.img" returned: 0 in 10.846s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025a766-baca-4764-990d-bd6542589ff5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:50:58 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 Nov 06 21:50:58 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:50:58 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:50:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:50:59 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Nov 06 21:50:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8" returned: 0 in 0.530s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:50:59 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8, size 1024.00 MB, duration 10.85 sec, destination /opt/stack/data/cinder/conversion/590232fd-80e1-4773-affd-59f69a8c87b8.temp_image.b1c932c0-cded-48cf-a89e-afd30e2e29edttrpviyk.img {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:50:59 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Converted 1024.00 MB image at 94.40 MB/s Nov 06 21:50:59 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] b1c932c0-cded-48cf-a89e-afd30e2e29ed was raw, no need to convert to raw {{(pid=87069) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=38,cinder:UPDATE=33,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=33,cinder:UPDATE=43,cinder:INSERT=9 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Flow 'volume_create_manager' (731838c1-59eb-48ba-8531-7a7af8ea6a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656e38e3-c419-4113-914e-a301453577af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656e38e3-c419-4113-914e-a301453577af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183358315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869b1dde-e26b-4462-ad7a-a3d254fc228a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84515e29d89c426795e7b9079c072b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:10Z,use_quota=True,user_id='501fe4705f1b488595f12db3c054c094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e697fb-a27d-4fbe-8bb8-50b1d40f1758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97e697fb-a27d-4fbe-8bb8-50b1d40f1758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725b7c7c-9038-4726-96af-3083f90e0019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725b7c7c-9038-4726-96af-3083f90e0019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '869b1dde-e26b-4462-ad7a-a3d254fc228a', 'volume_name': 'volume-869b1dde-e26b-4462-ad7a-a3d254fc228a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3a06c6-820a-4a0e-a637-25f3573daf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be3a06c6-820a-4a0e-a637-25f3573daf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352838d9-de35-49a7-b8ce-6096a82dcb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:09 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Volume 869b1dde-e26b-4462-ad7a-a3d254fc228a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-869b1dde-e26b-4462-ad7a-a3d254fc228a', 'volume_size': 1} Nov 06 21:51:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.161s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Uploaded volume to glance image-id: b1c932c0-cded-48cf-a89e-afd30e2e29ed. {{(pid=87069) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.245s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-76071606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c9e10b-255b-4525-8524-1d88c7e3d2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d315d7548074ded893be0a47d57c7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:51Z,use_quota=True,user_id='05ef0da7d3de4bbe84029f969757f6b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Creating volume f6c9e10b-255b-4525-8524-1d88c7e3d2a3 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:19 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:19 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 1073741824 Nov 06 21:51:19 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ff7c1c97-ea0c-46b7-8861-8fadc774527e tempest-TestImageHashVerification-1727496113 None] Copy volume to image completed successfully. Nov 06 21:51:20 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 1073741824" returned: 0 in 0.429s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:20 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 Nov 06 21:51:20 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:20 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3" returned: 0 in 0.251s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.488s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-411356032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bd7ebe-9ced-4267-a694-1ff8388b58b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dae51dc1d0a4a4cacaeff14c1b73e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:50:53Z,use_quota=True,user_id='13273694bd7d46e5aac05c101fec77ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Creating volume 16bd7ebe-9ced-4267-a694-1ff8388b58b8 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:20 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51798ab-8154-4c84-97ff-7fd1fe1345d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:20 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 1073741824 Nov 06 21:51:20 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec3f500-a56c-4639-bc30-f17b5f61ca4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:20 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Volume volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 (f6c9e10b-255b-4525-8524-1d88c7e3d2a3): created successfully Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec3f500-a56c-4639-bc30-f17b5f61ca4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Flow 'volume_create_manager' (8bf20df3-b392-4474-b66d-56cc85e8be5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4e63aa6e-698f-4e55-a21a-d03a0f3ccab2 tempest-TestMinimumBasicScenario-491976047 None] Created volume successfully. Nov 06 21:51:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Acquiring lock "cinder-590232fd-80e1-4773-affd-59f69a8c87b8-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Lock "cinder-590232fd-80e1-4773-affd-59f69a8c87b8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Acquiring lock "cinder-quobyte-590232fd-80e1-4773-affd-59f69a8c87b8" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Lock "cinder-quobyte-590232fd-80e1-4773-affd-59f69a8c87b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[973186f8-efc9-4477-a2f7-b2da509a8416]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:21 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 1073741824" returned: 0 in 0.509s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:21 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 Nov 06 21:51:21 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:21 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 Nov 06 21:51:21 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:21 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8" returned: 0 in 0.262s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:21 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.679s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1183358315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869b1dde-e26b-4462-ad7a-a3d254fc228a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84515e29d89c426795e7b9079c072b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:10Z,use_quota=True,user_id='501fe4705f1b488595f12db3c054c094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Creating volume 869b1dde-e26b-4462-ad7a-a3d254fc228a {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:21 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8" returned: 0 in 0.411s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:21 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a 1073741824 Nov 06 21:51:21 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fc2ca4-b7b3-4438-aaef-33bd9475ba23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:21 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8 Nov 06 21:51:21 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b312593-64ea-4272-ac98-e267d9062c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:21 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Volume volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 (16bd7ebe-9ced-4267-a694-1ff8388b58b8): created successfully Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b312593-64ea-4272-ac98-e267d9062c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Flow 'volume_create_manager' (f99517ef-2c5b-455a-a1db-c2d1b3a9ecdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dfcf7c6b-5e7b-4806-b738-a9374f6ee316 tempest-VolumesListAdminTestJSON-19087811 None] Created volume successfully. Nov 06 21:51:21 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-590232fd-80e1-4773-affd-59f69a8c87b8" returned: 0 in 0.301s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Lock "cinder-quobyte-590232fd-80e1-4773-affd-59f69a8c87b8" released by "delete_volume" :: held 0.757s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Created reservations ['dbc637dd-fb17-4c39-82d5-868e91aae973', '0e784f7b-b59f-4b99-81ef-11c4f9d9736a', 'e98581f3-3bc7-483c-84fb-2155ffba5c1a', 'c33bd54f-d2d0-4250-b658-1ac34187695f'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:21 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:21 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:22 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a 1073741824" returned: 0 in 0.527s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:22 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a Nov 06 21:51:22 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:22 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.335s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Deleted volume successfully. Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8e8e9578-a968-4480-9ef6-97b0d11c4c9c tempest-TestImageHashVerification-1727496113 None] Lock "cinder-590232fd-80e1-4773-affd-59f69a8c87b8-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:22 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352838d9-de35-49a7-b8ce-6096a82dcb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869b1dde-e26b-4462-ad7a-a3d254fc228a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f5e7ee-4b7e-4ed8-b064-a91411ecc769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:22 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Volume volume-869b1dde-e26b-4462-ad7a-a3d254fc228a (869b1dde-e26b-4462-ad7a-a3d254fc228a): created successfully Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f5e7ee-4b7e-4ed8-b064-a91411ecc769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Flow 'volume_create_manager' (731838c1-59eb-48ba-8531-7a7af8ea6a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7a2a4546-b6b0-4de0-974b-cea665e9311a tempest-ProjectReaderTests-753853100 None] Created volume successfully. Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1e4f643a-0baf-4563-ab4b-18a23e924210 req-44e649b1-050b-4a2b-9edf-80f5b5b0e6b8 tempest-TestMinimumBasicScenario-491976047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1e4f643a-0baf-4563-ab4b-18a23e924210 req-44e649b1-050b-4a2b-9edf-80f5b5b0e6b8 tempest-TestMinimumBasicScenario-491976047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-1e4f643a-0baf-4563-ab4b-18a23e924210 req-44e649b1-050b-4a2b-9edf-80f5b5b0e6b8 tempest-TestMinimumBasicScenario-491976047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-1e4f643a-0baf-4563-ab4b-18a23e924210 req-44e649b1-050b-4a2b-9edf-80f5b5b0e6b8 tempest-TestMinimumBasicScenario-491976047 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c064102f-6541-4be9-93bc-01cef0e8d432', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Flow 'volume_create_manager' (c79e1f35-0d54-4d1d-b023-b60cc82b31df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37022ec6-5053-4b79-b71e-9317e1fdd2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37022ec6-5053-4b79-b71e-9317e1fdd2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1752383710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9898290a-7511-4676-b729-0f56de1da709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dae51dc1d0a4a4cacaeff14c1b73e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:23Z,use_quota=True,user_id='13273694bd7d46e5aac05c101fec77ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25db9b81-48fa-4470-b6ed-52f5d37c04aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25db9b81-48fa-4470-b6ed-52f5d37c04aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65819eca-09af-4fbe-ac61-d3ffc53ac10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65819eca-09af-4fbe-ac61-d3ffc53ac10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9898290a-7511-4676-b729-0f56de1da709', 'volume_name': 'volume-9898290a-7511-4676-b729-0f56de1da709', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086fb527-d21a-4da3-9a20-a2652f463ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (086fb527-d21a-4da3-9a20-a2652f463ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863a98e9-f3d1-4eed-8d97-6b2acb71185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:22 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Volume 9898290a-7511-4676-b729-0f56de1da709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9898290a-7511-4676-b729-0f56de1da709', 'volume_size': 1} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1752383710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9898290a-7511-4676-b729-0f56de1da709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dae51dc1d0a4a4cacaeff14c1b73e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:23Z,use_quota=True,user_id='13273694bd7d46e5aac05c101fec77ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Creating volume 9898290a-7511-4676-b729-0f56de1da709 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:22 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:23 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 1073741824 Nov 06 21:51:23 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-1e4f643a-0baf-4563-ab4b-18a23e924210 req-44e649b1-050b-4a2b-9edf-80f5b5b0e6b8 tempest-TestMinimumBasicScenario-491976047 None] attachment_update completed successfully. Nov 06 21:51:23 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 1073741824" returned: 0 in 0.615s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:23 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 Nov 06 21:51:23 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Acquiring lock "cinder-869b1dde-e26b-4462-ad7a-a3d254fc228a-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Lock "cinder-869b1dde-e26b-4462-ad7a-a3d254fc228a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Acquiring lock "cinder-quobyte-869b1dde-e26b-4462-ad7a-a3d254fc228a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Lock "cinder-quobyte-869b1dde-e26b-4462-ad7a-a3d254fc228a" acquired by "delete_volume" :: waited 0.031s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:23 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709" returned: 0 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863a98e9-f3d1-4eed-8d97-6b2acb71185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9898290a-7511-4676-b729-0f56de1da709', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a47d216-8c81-4c85-a73a-dc4f0574aadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf425ee-f73c-4420-8abc-18c5a7b96b69]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:24 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Volume volume-9898290a-7511-4676-b729-0f56de1da709 (9898290a-7511-4676-b729-0f56de1da709): created successfully Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a47d216-8c81-4c85-a73a-dc4f0574aadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Flow 'volume_create_manager' (c79e1f35-0d54-4d1d-b023-b60cc82b31df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-37731532-8bb0-4d1b-8d45-345033881d15 tempest-VolumesListAdminTestJSON-19087811 None] Created volume successfully. Nov 06 21:51:24 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a Nov 06 21:51:24 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:24 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a" returned: 0 in 0.505s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:24 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a Nov 06 21:51:24 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:24 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-869b1dde-e26b-4462-ad7a-a3d254fc228a" returned: 0 in 0.383s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Lock "cinder-quobyte-869b1dde-e26b-4462-ad7a-a3d254fc228a" released by "delete_volume" :: held 0.974s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Created reservations ['63ce8e26-c82e-4504-9fcc-d5fabf948b0b', '36bfd757-7e9b-452d-8e5b-b1368c961656', 'da38024a-c5d7-41d4-80e6-40a3af3d1d7a', '7c8da9cb-1bb2-4530-8661-930a7f557270'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:25 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:25 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:25 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.294s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Deleted volume successfully. Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-920d9c3b-a694-448b-9615-90be4c24ab23 tempest-ProjectReaderTests-753853100 None] Lock "cinder-869b1dde-e26b-4462-ad7a-a3d254fc228a-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Flow 'volume_create_manager' (59a83330-5880-4d59-b742-d9f10284681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535aae26-95dd-420b-8d3e-91d244690739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535aae26-95dd-420b-8d3e-91d244690739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-862545008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59486b1-2e9e-4fcf-a37c-a755cb09444f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dae51dc1d0a4a4cacaeff14c1b73e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:26Z,use_quota=True,user_id='13273694bd7d46e5aac05c101fec77ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a53ff6e-3103-426a-92a6-8d243d45f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a53ff6e-3103-426a-92a6-8d243d45f888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b346149-bf47-4555-b079-caee2c54a441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b346149-bf47-4555-b079-caee2c54a441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b59486b1-2e9e-4fcf-a37c-a755cb09444f', 'volume_name': 'volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5778d4-88f9-4f18-802e-2197dbc7555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5778d4-88f9-4f18-802e-2197dbc7555e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ddf656-54b5-4e07-848d-c5cc5762a681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:25 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Volume b59486b1-2e9e-4fcf-a37c-a755cb09444f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f', 'volume_size': 1} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-862545008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59486b1-2e9e-4fcf-a37c-a755cb09444f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dae51dc1d0a4a4cacaeff14c1b73e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:26Z,use_quota=True,user_id='13273694bd7d46e5aac05c101fec77ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Creating volume b59486b1-2e9e-4fcf-a37c-a755cb09444f {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:25 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:25 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f 1073741824 Nov 06 21:51:25 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:26 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f 1073741824" returned: 0 in 0.532s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:26 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f Nov 06 21:51:26 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:26 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f" returned: 0 in 0.309s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ddf656-54b5-4e07-848d-c5cc5762a681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28717527-6009-47ae-8739-c7f5518506f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Flow 'volume_create_manager' (be76331b-9d70-432e-be77-41abac2da5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6241d0-0ecd-44b0-94d5-7908f6e29942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:26 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Volume volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f (b59486b1-2e9e-4fcf-a37c-a755cb09444f): created successfully Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28717527-6009-47ae-8739-c7f5518506f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Flow 'volume_create_manager' (59a83330-5880-4d59-b742-d9f10284681b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6241d0-0ecd-44b0-94d5-7908f6e29942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972979983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcab87a2-a220-47c1-9e84-137c65e90631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84515e29d89c426795e7b9079c072b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:27Z,use_quota=True,user_id='501fe4705f1b488595f12db3c054c094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4461ea48-d1a5-4f71-b1b2-2e47ecf4098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4461ea48-d1a5-4f71-b1b2-2e47ecf4098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74c15bd-347c-49d5-87bd-3214960837a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74c15bd-347c-49d5-87bd-3214960837a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcab87a2-a220-47c1-9e84-137c65e90631', 'volume_name': 'volume-bcab87a2-a220-47c1-9e84-137c65e90631', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fef940f-516c-4409-b650-2cd33859030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fef940f-516c-4409-b650-2cd33859030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74e61b2-dba5-4c8c-8e15-0257f9cdd721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:26 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Volume bcab87a2-a220-47c1-9e84-137c65e90631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcab87a2-a220-47c1-9e84-137c65e90631', 'volume_size': 1} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972979983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcab87a2-a220-47c1-9e84-137c65e90631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84515e29d89c426795e7b9079c072b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:27Z,use_quota=True,user_id='501fe4705f1b488595f12db3c054c094',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Creating volume bcab87a2-a220-47c1-9e84-137c65e90631 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:26 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c94fb87b-724b-4854-ad48-447e3fc290b2 tempest-VolumesListAdminTestJSON-19087811 None] Created volume successfully. Nov 06 21:51:26 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 1073741824 Nov 06 21:51:26 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:27 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 1073741824" returned: 0 in 0.614s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:27 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 Nov 06 21:51:27 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:27 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631" returned: 0 in 0.397s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74e61b2-dba5-4c8c-8e15-0257f9cdd721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcab87a2-a220-47c1-9e84-137c65e90631', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cb5c0a-5caa-4418-920f-ec63dc4931cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:27 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Volume volume-bcab87a2-a220-47c1-9e84-137c65e90631 (bcab87a2-a220-47c1-9e84-137c65e90631): created successfully Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cb5c0a-5caa-4418-920f-ec63dc4931cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Flow 'volume_create_manager' (be76331b-9d70-432e-be77-41abac2da5b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2ba382ba-9863-449c-a850-bbd811c85e58 tempest-ProjectReaderTests-753853100 None] Created volume successfully. Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Flow 'volume_create_manager' (091c9dde-269b-4553-9a68-355c2b3d1784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6770cc12-a3ca-4f46-a695-1d7d0f995421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Acquiring lock "cinder-bcab87a2-a220-47c1-9e84-137c65e90631-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6770cc12-a3ca-4f46-a695-1d7d0f995421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c469e1b-ab37-48c4-8fec-758eea1b83d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0d1ed036f948f58c948eba26318599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:29Z,use_quota=True,user_id='513541edd6af4ed9bbc23ad455fb1798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69a3803-5c74-41b5-971a-e5fbfea4ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69a3803-5c74-41b5-971a-e5fbfea4ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfd0131-25b2-45cc-9a52-2fb5c7cdc4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfd0131-25b2-45cc-9a52-2fb5c7cdc4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c469e1b-ab37-48c4-8fec-758eea1b83d3', 'volume_name': 'volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43672a8b-846c-442b-864a-8efef28c2e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43672a8b-846c-442b-864a-8efef28c2e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548c1a18-1e34-4895-9160-0e0a27d475d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:28 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Volume 0c469e1b-ab37-48c4-8fec-758eea1b83d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3', 'volume_size': 1} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c469e1b-ab37-48c4-8fec-758eea1b83d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df0d1ed036f948f58c948eba26318599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:29Z,use_quota=True,user_id='513541edd6af4ed9bbc23ad455fb1798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Creating volume 0c469e1b-ab37-48c4-8fec-758eea1b83d3 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:28 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Lock "cinder-bcab87a2-a220-47c1-9e84-137c65e90631-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:29 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 1073741824 Nov 06 21:51:29 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Acquiring lock "cinder-quobyte-bcab87a2-a220-47c1-9e84-137c65e90631" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Lock "cinder-quobyte-bcab87a2-a220-47c1-9e84-137c65e90631" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:29 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ef8d53-1779-4608-adf6-dbc82e42477b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:29 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 Nov 06 21:51:29 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:29 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 1073741824" returned: 0 in 0.702s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:29 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 Nov 06 21:51:29 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:29 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631" returned: 0 in 0.635s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:29 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631 Nov 06 21:51:29 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:30 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcab87a2-a220-47c1-9e84-137c65e90631" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Lock "cinder-quobyte-bcab87a2-a220-47c1-9e84-137c65e90631" released by "delete_volume" :: held 0.984s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:30 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3" returned: 0 in 0.365s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548c1a18-1e34-4895-9160-0e0a27d475d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adb39d0-0bbe-428d-b166-91008c2e08d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:30 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Volume volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 (0c469e1b-ab37-48c4-8fec-758eea1b83d3): created successfully Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0adb39d0-0bbe-428d-b166-91008c2e08d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Flow 'volume_create_manager' (091c9dde-269b-4553-9a68-355c2b3d1784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1057c174-6bb8-4c6b-ad27-e150f9902f9e tempest-VolumesListAdminTestJSON-852307391 None] Created volume successfully. Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Created reservations ['d4d78b3b-7b54-42c5-976f-d902bb736423', '7bcb8d50-4114-4c1d-9e0f-7edfff5bbe5c', '1d743d59-dac3-48c6-9b10-d21449c16cdd', 'bc8ea336-660e-4338-8a2a-8ac272e280c4'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:30 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:30 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:30 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.343s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Deleted volume successfully. Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b05e1f42-a6af-4933-8721-996943344747 tempest-ProjectReaderTests-753853100 None] Lock "cinder-bcab87a2-a220-47c1-9e84-137c65e90631-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Acquiring lock "cinder-0c469e1b-ab37-48c4-8fec-758eea1b83d3-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Lock "cinder-0c469e1b-ab37-48c4-8fec-758eea1b83d3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Acquiring lock "cinder-quobyte-0c469e1b-ab37-48c4-8fec-758eea1b83d3" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Lock "cinder-quobyte-0c469e1b-ab37-48c4-8fec-758eea1b83d3" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d3d2a9-b99a-4d2d-9b39-2efa2bef52dd]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "cinder-b59486b1-2e9e-4fcf-a37c-a755cb09444f-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-b59486b1-2e9e-4fcf-a37c-a755cb09444f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:31 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 Nov 06 21:51:31 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "cinder-quobyte-b59486b1-2e9e-4fcf-a37c-a755cb09444f" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-quobyte-b59486b1-2e9e-4fcf-a37c-a755cb09444f" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1142d136-a06a-4cd9-ba15-b001c8b5837e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:31 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f Nov 06 21:51:31 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:31 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3" returned: 0 in 0.533s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:31 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3 Nov 06 21:51:31 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:32 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f" returned: 0 in 0.694s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:32 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0c469e1b-ab37-48c4-8fec-758eea1b83d3" returned: 0 in 0.473s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:32 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f Nov 06 21:51:32 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Lock "cinder-quobyte-0c469e1b-ab37-48c4-8fec-758eea1b83d3" released by "delete_volume" :: held 1.086s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Created reservations ['4f7fdef3-6840-4215-8d2f-07067b00b184', 'e3eccfcc-b2be-42cc-9785-c0089d507c37', '80da8631-7804-42c8-bae7-17f0e9f77681', 'cfad35a1-75d9-4d59-a9ca-6965d28d0edc'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:32 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:32 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:32 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b59486b1-2e9e-4fcf-a37c-a755cb09444f" returned: 0 in 0.380s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-quobyte-b59486b1-2e9e-4fcf-a37c-a755cb09444f" released by "delete_volume" :: held 1.146s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Created reservations ['2681d4cd-a395-4478-aec5-12d7bb3c34e7', '379b0c16-a742-4a51-b446-ef4e9a7d5b16', '50310775-35b5-4bcd-81d9-443301d1138c', 'aa646b32-d36f-474d-90dd-c0e9723b545c'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:32 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:32 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:32 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.284s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Deleted volume successfully. Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f0aa80-fd91-494c-8c01-29bba1826736 tempest-VolumesListAdminTestJSON-852307391 None] Lock "cinder-0c469e1b-ab37-48c4-8fec-758eea1b83d3-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:32 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.291s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Deleted volume successfully. Nov 06 21:51:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cf14dc37-3e81-413a-9ab3-69f85bb90f00 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-b59486b1-2e9e-4fcf-a37c-a755cb09444f-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "cinder-9898290a-7511-4676-b729-0f56de1da709-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-9898290a-7511-4676-b729-0f56de1da709-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "cinder-quobyte-9898290a-7511-4676-b729-0f56de1da709" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-quobyte-9898290a-7511-4676-b729-0f56de1da709" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc60b3e-4f7a-4f4f-abf1-df9a75a07b25]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:33 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 Nov 06 21:51:33 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:34 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709" returned: 0 in 0.516s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:34 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709 Nov 06 21:51:34 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:34 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9898290a-7511-4676-b729-0f56de1da709" returned: 0 in 0.473s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-quobyte-9898290a-7511-4676-b729-0f56de1da709" released by "delete_volume" :: held 1.075s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Created reservations ['1cdef370-4c9b-4e79-91a9-fe22e23a06c3', '48ab07eb-5f08-4068-a010-14100f2398c3', 'b2e98ee6-8867-4661-ad94-83e671cd3dc1', '57bc0fd0-807d-481b-a4f0-b037075afe93'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:35 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:35 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:35 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.319s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:35 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:35 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Deleted volume successfully. Nov 06 21:51:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e0d8d510-2e86-41a1-b917-d5efa2135b09 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-9898290a-7511-4676-b729-0f56de1da709-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "cinder-16bd7ebe-9ced-4267-a694-1ff8388b58b8-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-16bd7ebe-9ced-4267-a694-1ff8388b58b8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "cinder-quobyte-16bd7ebe-9ced-4267-a694-1ff8388b58b8" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-quobyte-16bd7ebe-9ced-4267-a694-1ff8388b58b8" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc57b4f-f088-424c-98c7-51e8fef31012]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:36 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 Nov 06 21:51:36 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:36 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8" returned: 0 in 0.467s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:36 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8 Nov 06 21:51:36 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:36 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-16bd7ebe-9ced-4267-a694-1ff8388b58b8" returned: 0 in 0.271s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-quobyte-16bd7ebe-9ced-4267-a694-1ff8388b58b8" released by "delete_volume" :: held 0.795s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Created reservations ['4dd8838e-d1cc-4d1d-bffc-b7ad9c865c3f', '8df86f04-318b-4ffa-b933-e29840118379', '56e0aaaf-4def-4070-946c-626af115db92', 'e5929d90-ebb2-40c4-a6b0-b907a26e7957'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:37 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:37 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:37 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.345s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Deleted volume successfully. Nov 06 21:51:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-39a4f4de-50de-4495-bd45-c76a741b9a39 tempest-VolumesListAdminTestJSON-19087811 None] Lock "cinder-16bd7ebe-9ced-4267-a694-1ff8388b58b8-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Flow 'volume_create_manager' (b8d68a5e-e64e-443e-a064-fedfdf8dde65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c77f78-e1db-4335-8494-bfd7b57d1ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c77f78-e1db-4335-8494-bfd7b57d1ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1364292294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded70ba1-00a3-4713-9ab1-57390b5a35ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc0afa9c97543a083afd3cc50212407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:44Z,use_quota=True,user_id='ebd9115822a44e6098d7f49bcdfcd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5d282c-87ff-46bf-9e39-1c03ee2f96bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be5d282c-87ff-46bf-9e39-1c03ee2f96bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc563103-92ba-4fd7-a9cb-baa09da6d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Flow 'volume_create_manager' (51eb173e-1d5b-4d50-8546-a350ca83c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c1f14f-754d-40a7-ae3c-bd49fb39cf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c1f14f-754d-40a7-ae3c-bd49fb39cf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f9a98eff4f48debaa50ebcb2b29d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:44Z,use_quota=True,user_id='05b30ba71f164e099c5379765734a35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1b89799-df7e-4a34-9214-e32b97ef2f34),volume_type_id=a1b89799-df7e-4a34-9214-e32b97ef2f34)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d55e41-3593-43e7-864f-33e98b2cfad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d55e41-3593-43e7-864f-33e98b2cfad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c475fc54-b3b8-4170-9317-3b020a8e1f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc563103-92ba-4fd7-a9cb-baa09da6d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ded70ba1-00a3-4713-9ab1-57390b5a35ee', 'volume_name': 'volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c2660c-39c3-4695-a338-a3bc1527ac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5c2660c-39c3-4695-a338-a3bc1527ac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d62dd07-5a24-49de-a07c-9350d9a3b7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Volume ded70ba1-00a3-4713-9ab1-57390b5a35ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Trying to clone ded70ba1-00a3-4713-9ab1-57390b5a35ee from image 190b0bd5-9057-4553-8deb-2ec752071230 at location (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c475fc54-b3b8-4170-9317-3b020a8e1f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46', 'volume_name': 'volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46', 'volume_size': 1, 'image_id': '281f82c4-480e-4303-ac13-d125344b893e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/281f82c4-480e-4303-ac13-d125344b893e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66d20bb901e6007f878722ffc3768d64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2f9a98eff4f48debaa50ebcb2b29d32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2501ae8b84dbf0e532e603fe2abf3eace17ffeb7ddb5d6a3027eb1c2f01ba55a62cea5bf62ccca433289c771b0184853fea1055772498b51c9fa0270529e36de', 'id': '281f82c4-480e-4303-ac13-d125344b893e', 'created_at': datetime.datetime(2026, 11, 6, 20, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 51, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/281f82c4-480e-4303-ac13-d125344b893e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec94a0de-d492-4940-b4ea-6465f49d35bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec94a0de-d492-4940-b4ea-6465f49d35bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1faf372d-3493-4bc4-9003-645ed50868cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:44 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Volume f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46', 'volume_size': 1, 'image_id': '281f82c4-480e-4303-ac13-d125344b893e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/281f82c4-480e-4303-ac13-d125344b893e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66d20bb901e6007f878722ffc3768d64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2f9a98eff4f48debaa50ebcb2b29d32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2501ae8b84dbf0e532e603fe2abf3eace17ffeb7ddb5d6a3027eb1c2f01ba55a62cea5bf62ccca433289c771b0184853fea1055772498b51c9fa0270529e36de', 'id': '281f82c4-480e-4303-ac13-d125344b893e', 'created_at': datetime.datetime(2026, 11, 6, 20, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 51, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/281f82c4-480e-4303-ac13-d125344b893e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Trying to clone f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 from image 281f82c4-480e-4303-ac13-d125344b893e at location (None, [{'url': 'file:///opt/stack/data/glance/images/281f82c4-480e-4303-ac13-d125344b893e', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:51:44 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:51:44 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[511db559-4618-4609-900b-70dd1558f488]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:51:45 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Image download 20.69 MB at 20.69 MB/s Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2403e6-ac9a-47dc-88ed-6302486695f6]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:45 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD Nov 06 21:51:45 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:45 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD Nov 06 21:51:45 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:45 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:45 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 is fetched for user ebd9115822a44e6098d7f49bcdfcd689. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:51:45 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD Nov 06 21:51:45 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[535a1ced-7cea-4a0b-8e4f-823ccbee959d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:45 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD Nov 06 21:51:45 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:45 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Temporary image 281f82c4-480e-4303-ac13-d125344b893e is fetched for user 05b30ba71f164e099c5379765734a35f. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f219df-d045-4b87-8b9c-f83ed36af8c0]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:46 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1364292294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded70ba1-00a3-4713-9ab1-57390b5a35ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc0afa9c97543a083afd3cc50212407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:44Z,use_quota=True,user_id='ebd9115822a44e6098d7f49bcdfcd689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Creating volume ded70ba1-00a3-4713-9ab1-57390b5a35ee {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:46 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD Nov 06 21:51:46 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:46 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:46 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee 1073741824 Nov 06 21:51:46 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:46 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:46 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD Nov 06 21:51:46 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:46 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee 1073741824" returned: 0 in 0.483s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:46 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee Nov 06 21:51:46 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:46 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD" returned: 1 in 0.373s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:46 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.187s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2f9a98eff4f48debaa50ebcb2b29d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:51:44Z,use_quota=True,user_id='05b30ba71f164e099c5379765734a35f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1b89799-df7e-4a34-9214-e32b97ef2f34),volume_type_id=a1b89799-df7e-4a34-9214-e32b97ef2f34)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Creating volume f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:51:46 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:46 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 1073741824 Nov 06 21:51:46 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Attempting download of 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume ded70ba1-00a3-4713-9ab1-57390b5a35ee. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cad1ecd-d5a9-49e9-9f5c-9b8ae2943fb5]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_koi79i3_ {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:47 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_koi79i3_ Nov 06 21:51:47 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:47 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_koi79i3_" returned: 0 in 0.331s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_koi79i3_ {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:47 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 1073741824" returned: 0 in 0.445s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:47 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 Nov 06 21:51:47 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:47 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_koi79i3_ Nov 06 21:51:47 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:47 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46" returned: 0 in 0.277s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Attempting download of 281f82c4-480e-4303-ac13-d125344b893e ((None, [{'url': 'file:///opt/stack/data/glance/images/281f82c4-480e-4303-ac13-d125344b893e', 'metadata': {}}])) to volume f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:51:47 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_koi79i3_" returned: 1 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_190b0bd5-9057-4553-8deb-2ec752071230_koi79i3_' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[40443927-dac3-4c50-910b-d2751dbc6fe6]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2296fd-897e-40a7-a933-a8b1e83fe9ca]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_281f82c4-480e-4303-ac13-d125344b893e_i65vug90 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:47 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD Nov 06 21:51:47 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:47 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_281f82c4-480e-4303-ac13-d125344b893e_i65vug90 Nov 06 21:51:47 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:47 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] 190b0bd5-9057-4553-8deb-2ec752071230 was qcow2, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:48 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:48 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee Nov 06 21:51:48 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_281f82c4-480e-4303-ac13-d125344b893e_i65vug90" returned: 0 in 0.352s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_281f82c4-480e-4303-ac13-d125344b893e_i65vug90 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:48 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_281f82c4-480e-4303-ac13-d125344b893e_i65vug90 Nov 06 21:51:48 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:48 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_281f82c4-480e-4303-ac13-d125344b893e_i65vug90" returned: 1 in 0.352s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_281f82c4-480e-4303-ac13-d125344b893e_i65vug90' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[582b60ec-d4d0-465d-9e59-6c494ad5c0bf]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:48 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD Nov 06 21:51:48 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:48 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:48 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD Nov 06 21:51:48 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:49 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] 281f82c4-480e-4303-ac13-d125344b893e was raw, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:49 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 Nov 06 21:51:49 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:49 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46" returned: 0 in 0.650s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_281f82c4-480e-4303-ac13-d125344b893e_k0cpcolddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:51:49 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:49 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 1G Nov 06 21:51:49 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:49 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee" returned: 0 in 1.949s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_190b0bd5-9057-4553-8deb-2ec752071230_ao9tzwezdevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:51:49 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Converted 112.00 MB image at 57.42 MB/s Nov 06 21:51:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:49 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee 1G Nov 06 21:51:49 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:50 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 1G" returned: 0 in 0.321s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Downloaded image 281f82c4-480e-4303-ac13-d125344b893e ((None, [{'url': 'file:///opt/stack/data/glance/images/281f82c4-480e-4303-ac13-d125344b893e', 'metadata': {}}])) to volume f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Temporary image 281f82c4-480e-4303-ac13-d125344b893e for user 05b30ba71f164e099c5379765734a35f is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Marking volume f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Copying metadata from image 281f82c4-480e-4303-ac13-d125344b893e to f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Creating volume glance metadata for volume f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 backed by image 281f82c4-480e-4303-ac13-d125344b893e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '281f82c4-480e-4303-ac13-d125344b893e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '66d20bb901e6007f878722ffc3768d64', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1faf372d-3493-4bc4-9003-645ed50868cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46', 'volume_size': 1, 'image_id': '281f82c4-480e-4303-ac13-d125344b893e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/281f82c4-480e-4303-ac13-d125344b893e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66d20bb901e6007f878722ffc3768d64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f2f9a98eff4f48debaa50ebcb2b29d32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2501ae8b84dbf0e532e603fe2abf3eace17ffeb7ddb5d6a3027eb1c2f01ba55a62cea5bf62ccca433289c771b0184853fea1055772498b51c9fa0270529e36de', 'id': '281f82c4-480e-4303-ac13-d125344b893e', 'created_at': datetime.datetime(2026, 11, 6, 20, 51, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 51, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/281f82c4-480e-4303-ac13-d125344b893e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1531b8d8-693b-4d5c-84fa-f85318d2463b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Volume volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 (f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46): created successfully Nov 06 21:51:50 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1531b8d8-693b-4d5c-84fa-f85318d2463b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Flow 'volume_create_manager' (51eb173e-1d5b-4d50-8546-a350ca83c02b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee 1G" returned: 0 in 0.352s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Downloaded image 190b0bd5-9057-4553-8deb-2ec752071230 ((None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}])) to volume ded70ba1-00a3-4713-9ab1-57390b5a35ee successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Temporary image 190b0bd5-9057-4553-8deb-2ec752071230 for user ebd9115822a44e6098d7f49bcdfcd689 is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Marking volume ded70ba1-00a3-4713-9ab1-57390b5a35ee as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:51:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7bf80b98-6f3f-41d4-8bda-8e942e1efd78 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Created volume successfully. Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Copying metadata from image 190b0bd5-9057-4553-8deb-2ec752071230 to ded70ba1-00a3-4713-9ab1-57390b5a35ee. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Creating volume glance metadata for volume ded70ba1-00a3-4713-9ab1-57390b5a35ee backed by image 190b0bd5-9057-4553-8deb-2ec752071230 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d62dd07-5a24-49de-a07c-9350d9a3b7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee', 'volume_size': 1, 'image_id': '190b0bd5-9057-4553-8deb-2ec752071230', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/190b0bd5-9057-4553-8deb-2ec752071230', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '36aeb39501c14878b5691af3ed1d36a6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '190b0bd5-9057-4553-8deb-2ec752071230', 'created_at': datetime.datetime(2026, 11, 6, 20, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 32, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/190b0bd5-9057-4553-8deb-2ec752071230/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddf3202-3cf3-4603-9b0a-03c8d15f3331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:51:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Volume volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee (ded70ba1-00a3-4713-9ab1-57390b5a35ee): created successfully Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddf3202-3cf3-4603-9b0a-03c8d15f3331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Flow 'volume_create_manager' (b8d68a5e-e64e-443e-a064-fedfdf8dde65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:51:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-675deea3-b9dd-4da4-80ef-96da52c7b949 tempest-VolumesImageMetadata-612540409 None] Created volume successfully. Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Acquiring lock "cinder-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "cinder-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Acquiring lock "cinder-quobyte-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "cinder-quobyte-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46" acquired by "delete_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13383db-ec07-48ee-81aa-93c899a01d68]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:51 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 Nov 06 21:51:51 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Acquiring lock "cinder-ded70ba1-00a3-4713-9ab1-57390b5a35ee-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Lock "cinder-ded70ba1-00a3-4713-9ab1-57390b5a35ee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Acquiring lock "cinder-quobyte-ded70ba1-00a3-4713-9ab1-57390b5a35ee" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Lock "cinder-quobyte-ded70ba1-00a3-4713-9ab1-57390b5a35ee" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dc50b9-d985-46af-a46a-2a57745eea3d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:51 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46" returned: 0 in 0.430s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:51 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46 Nov 06 21:51:51 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:51 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee Nov 06 21:51:51 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:51 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "cinder-quobyte-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46" released by "delete_volume" :: held 0.752s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:51 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee" returned: 0 in 0.378s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:51 devstack cinder-volume[87069]: WARNING cinder.quota [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:51:51 devstack cinder-volume[87069]: WARNING cinder.quota [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:51:51 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee Nov 06 21:51:51 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Created reservations ['485b1c14-28b9-48eb-970b-d20a9cddb737', 'd4144999-b4d1-4e9f-9fa6-3151b9c7ff26', '0cd37a74-c5f7-4e74-8a9a-a2ac57060f38', 'fdef586e-c7f3-48e6-865f-ae51407b13a9'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:51 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:51 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:52 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ded70ba1-00a3-4713-9ab1-57390b5a35ee" returned: 0 in 0.302s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Lock "cinder-quobyte-ded70ba1-00a3-4713-9ab1-57390b5a35ee" released by "delete_volume" :: held 0.745s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Created reservations ['a25fc7e4-2de1-4462-bd84-7779fc745661', 'bf537bbd-749e-4a14-a8d1-4f3c457bdbf8', 'dfc42ce4-f6da-4bf9-8cb9-2148f0e675c2', '8026984b-8f52-4651-a8ac-0314fdab446c'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:51:52 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.336s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Deleted volume successfully. Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab8afac4-b18e-4aee-86a4-2c5216363d32 tempest-VolumeAndVolumeTypeFromImageTest-1848844941 None] Lock "cinder-f4b89e88-15fe-4b2b-ba7c-3a48a3bdfa46-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:52 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:52 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:52 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.299s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Deleted volume successfully. Nov 06 21:51:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e14b4ee5-6e8e-4207-9f05-327e8fb41074 tempest-VolumesImageMetadata-612540409 None] Lock "cinder-ded70ba1-00a3-4713-9ab1-57390b5a35ee-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:51:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:51:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:51:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:51:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:51:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:51:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:51:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:51:58 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:51:58 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:51:59 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Nov 06 21:51:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.290s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:51:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:51:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:51:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:51:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:52:02 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=82,cinder:UPDATE=97,cinder:DELETE=12,cinder:INSERT=28 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:52:02 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=82,cinder:INSERT=40,cinder:UPDATE=110,cinder:DELETE=6 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Flow 'volume_create_manager' (bfbfb481-1924-4b30-87d6-daf2f28152d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5084d6e9-30a8-44ad-9fb0-7b0488d32a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5084d6e9-30a8-44ad-9fb0-7b0488d32a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115756011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e80e13-0079-46aa-90a4-8b79eba3f0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736862fe77e40d99134fbfc3c04f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:03Z,use_quota=True,user_id='99b111cf557e4edeac7f9ee0f657aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9a53bc-8493-459a-995c-4c0ed5762855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9a53bc-8493-459a-995c-4c0ed5762855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7141b585-a038-47cc-b9fa-312f8a6a94d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7141b585-a038-47cc-b9fa-312f8a6a94d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0e80e13-0079-46aa-90a4-8b79eba3f0dd', 'volume_name': 'volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a090cd-d697-4da3-b0f2-a2312629ac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68a090cd-d697-4da3-b0f2-a2312629ac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568351b2-2163-4439-95a6-00a6024f3ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:03 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Volume a0e80e13-0079-46aa-90a4-8b79eba3f0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd', 'volume_size': 1} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-115756011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0e80e13-0079-46aa-90a4-8b79eba3f0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736862fe77e40d99134fbfc3c04f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:03Z,use_quota=True,user_id='99b111cf557e4edeac7f9ee0f657aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Creating volume a0e80e13-0079-46aa-90a4-8b79eba3f0dd {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:52:03 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:03 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd 1073741824 Nov 06 21:52:03 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:03 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd 1073741824" returned: 0 in 0.547s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:03 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd Nov 06 21:52:03 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:04 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd" returned: 0 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:52:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568351b2-2163-4439-95a6-00a6024f3ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8865b36f-33c3-44fc-9116-968f8e91f488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:04 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Volume volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd (a0e80e13-0079-46aa-90a4-8b79eba3f0dd): created successfully Nov 06 21:52:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8865b36f-33c3-44fc-9116-968f8e91f488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Flow 'volume_create_manager' (bfbfb481-1924-4b30-87d6-daf2f28152d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-12159aa4-b8a5-41af-b0e8-86660cbfc9a1 tempest-ProjectReaderTests-1122558381 None] Created volume successfully. Nov 06 21:52:05 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-99e6191d-9d14-4939-b505-7a23a2308e55 req-59e816cc-52b6-4a0f-88d1-204fda09dece tempest-TestMinimumBasicScenario-491976047 None] Terminate volume connection completed successfully. Nov 06 21:52:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-99e6191d-9d14-4939-b505-7a23a2308e55 req-59e816cc-52b6-4a0f-88d1-204fda09dece tempest-TestMinimumBasicScenario-491976047 None] Deleting attachment c064102f-6541-4be9-93bc-01cef0e8d432. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:52:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "cinder-a0e80e13-0079-46aa-90a4-8b79eba3f0dd-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-a0e80e13-0079-46aa-90a4-8b79eba3f0dd-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "cinder-quobyte-a0e80e13-0079-46aa-90a4-8b79eba3f0dd" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:05 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-quobyte-a0e80e13-0079-46aa-90a4-8b79eba3f0dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:05 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb91877-8f55-42b3-8c06-f916afff62a7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:52:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:05 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd Nov 06 21:52:05 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:06 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd" returned: 0 in 0.430s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:06 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd Nov 06 21:52:06 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Acquiring lock "cinder-f6c9e10b-255b-4525-8524-1d88c7e3d2a3-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Lock "cinder-f6c9e10b-255b-4525-8524-1d88c7e3d2a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Acquiring lock "cinder-quobyte-f6c9e10b-255b-4525-8524-1d88c7e3d2a3" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Lock "cinder-quobyte-f6c9e10b-255b-4525-8524-1d88c7e3d2a3" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8239510-b9c1-4bfd-a543-3c3f9d8bade7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:06 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 Nov 06 21:52:06 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:06 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0e80e13-0079-46aa-90a4-8b79eba3f0dd" returned: 0 in 0.415s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-quobyte-a0e80e13-0079-46aa-90a4-8b79eba3f0dd" released by "delete_volume" :: held 0.897s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Created reservations ['b1df0abb-170e-46a5-b11c-bc7194651643', 'b0e6e92c-0ae1-441a-b022-9694c0a97cd3', 'a0d6b13a-484a-4793-87ed-8de6e08348b5', '0f95a18e-f9d1-4b70-9219-e26ccbc5c6c7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:06 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:52:06 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:06 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3" returned: 0 in 0.502s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:06 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3 Nov 06 21:52:06 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:07 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.286s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:52:07 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Deleted volume successfully. Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2ec5c5b-8245-40aa-86ca-017cb4fa5c43 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-a0e80e13-0079-46aa-90a4-8b79eba3f0dd-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:07 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f6c9e10b-255b-4525-8524-1d88c7e3d2a3" returned: 0 in 0.296s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Lock "cinder-quobyte-f6c9e10b-255b-4525-8524-1d88c7e3d2a3" released by "delete_volume" :: held 0.852s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Created reservations ['ec5591be-a5a0-42cf-9ffe-02c66f741a92', '0dc2dc1d-24d6-4902-aaa9-033fe0b3671c', 'aed46800-7897-48bc-b5e2-542eedaa9c85', '71b10845-adc2-4a42-9ed1-ac3eef658e6a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:07 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:52:07 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:07 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.327s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:52:07 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Deleted volume successfully. Nov 06 21:52:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e23f52b-fef0-4650-a149-834e0f4b0ea0 tempest-TestMinimumBasicScenario-491976047 None] Lock "cinder-f6c9e10b-255b-4525-8524-1d88c7e3d2a3-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Flow 'volume_create_manager' (3d84c420-6b7f-49f3-8f6b-33961a85fe31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae73f358-c7e1-4113-88b6-57092be57a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae73f358-c7e1-4113-88b6-57092be57a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613261211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323c3e08-9941-4c46-9ae5-a42994750e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736862fe77e40d99134fbfc3c04f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:08Z,use_quota=True,user_id='99b111cf557e4edeac7f9ee0f657aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e06a2e-c7aa-4ec0-8fdb-7a93b5e207f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2e06a2e-c7aa-4ec0-8fdb-7a93b5e207f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89360a66-6b96-458c-baf7-4680993690b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89360a66-6b96-458c-baf7-4680993690b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323c3e08-9941-4c46-9ae5-a42994750e14', 'volume_name': 'volume-323c3e08-9941-4c46-9ae5-a42994750e14', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56989f6-e968-4751-aa13-0bca4b2aa7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56989f6-e968-4751-aa13-0bca4b2aa7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e84603e-cfdc-43a5-83ef-68f165b73dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:08 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Volume 323c3e08-9941-4c46-9ae5-a42994750e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323c3e08-9941-4c46-9ae5-a42994750e14', 'volume_size': 1} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613261211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323c3e08-9941-4c46-9ae5-a42994750e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736862fe77e40d99134fbfc3c04f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:08Z,use_quota=True,user_id='99b111cf557e4edeac7f9ee0f657aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Creating volume 323c3e08-9941-4c46-9ae5-a42994750e14 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:52:08 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:52:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:08 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 1073741824 Nov 06 21:52:08 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:09 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 1073741824" returned: 0 in 0.674s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:09 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 Nov 06 21:52:09 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:09 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14" returned: 0 in 0.382s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e84603e-cfdc-43a5-83ef-68f165b73dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323c3e08-9941-4c46-9ae5-a42994750e14', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164f80d0-5df4-4f65-8ca8-c3874d4de5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:09 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Volume volume-323c3e08-9941-4c46-9ae5-a42994750e14 (323c3e08-9941-4c46-9ae5-a42994750e14): created successfully Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164f80d0-5df4-4f65-8ca8-c3874d4de5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Flow 'volume_create_manager' (3d84c420-6b7f-49f3-8f6b-33961a85fe31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:09 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-516bb999-0312-47f7-8c01-39e3353e0adf tempest-ProjectReaderTests-1122558381 None] Created volume successfully. Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Flow 'volume_create_manager' (5eb64bca-2049-493a-be86-c325c7bd856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d8d731-c9d6-484e-a054-6de9a79a5b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d8d731-c9d6-484e-a054-6de9a79a5b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1610610244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c4bb40-a04b-463d-8886-f1cd58d34340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d470661f79b440e4a2203cfe85ae6d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:10Z,use_quota=True,user_id='1c7f0e2d9b0d47ccac9405fb4207eea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3e9324-5c4e-470f-961d-8390ff85bfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3e9324-5c4e-470f-961d-8390ff85bfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f359eb2-934f-4c65-9712-64cdd49c9f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f359eb2-934f-4c65-9712-64cdd49c9f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c4bb40-a04b-463d-8886-f1cd58d34340', 'volume_name': 'volume-b2c4bb40-a04b-463d-8886-f1cd58d34340', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d5dc4e-6fed-4cde-874d-ae734670773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d5dc4e-6fed-4cde-874d-ae734670773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5487b3c4-4c53-4b95-8440-b28812d2e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:10 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Volume b2c4bb40-a04b-463d-8886-f1cd58d34340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c4bb40-a04b-463d-8886-f1cd58d34340', 'volume_size': 1} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1610610244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2c4bb40-a04b-463d-8886-f1cd58d34340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d470661f79b440e4a2203cfe85ae6d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:10Z,use_quota=True,user_id='1c7f0e2d9b0d47ccac9405fb4207eea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Creating volume b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:52:10 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:10 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 1073741824 Nov 06 21:52:10 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "cinder-323c3e08-9941-4c46-9ae5-a42994750e14-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-323c3e08-9941-4c46-9ae5-a42994750e14-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "cinder-quobyte-323c3e08-9941-4c46-9ae5-a42994750e14" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-quobyte-323c3e08-9941-4c46-9ae5-a42994750e14" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e42896f-edff-4bb2-b148-501129f75bb8]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:52:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:10 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 Nov 06 21:52:10 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:11 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 1073741824" returned: 0 in 0.514s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:11 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:52:11 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:11 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14" returned: 0 in 0.439s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:11 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14 Nov 06 21:52:11 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:11 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5487b3c4-4c53-4b95-8440-b28812d2e579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c4bb40-a04b-463d-8886-f1cd58d34340', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d688d9-94f6-4d7c-b724-5698a31e7e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:11 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Volume volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 (b2c4bb40-a04b-463d-8886-f1cd58d34340): created successfully Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d688d9-94f6-4d7c-b724-5698a31e7e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Flow 'volume_create_manager' (5eb64bca-2049-493a-be86-c325c7bd856c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a6a0de3e-263a-4ee6-badd-4be51ea29bb1 tempest-VolumesActionsTest-198523789 None] Created volume successfully. Nov 06 21:52:11 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-323c3e08-9941-4c46-9ae5-a42994750e14" returned: 0 in 0.290s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-quobyte-323c3e08-9941-4c46-9ae5-a42994750e14" released by "delete_volume" :: held 0.783s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Created reservations ['475c93f5-9c71-45f8-af93-986c6d956bb6', '8072c92b-3b0f-4a76-9ed6-cb110e5c9180', '95dc1dda-79d7-4b70-bc51-62a8f4f1c715', '01d7e76b-510b-4467-8749-b8f533a64bef'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:11 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:52:11 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:11 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.283s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:52:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Deleted volume successfully. Nov 06 21:52:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b9f23eee-f085-4b44-ad4c-9c555b1d5487 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-323c3e08-9941-4c46-9ae5-a42994750e14-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Flow 'volume_create_manager' (dcfce715-13b9-49f3-8d21-09e480fa2df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d093bca7-6a3f-49ec-9422-c3ab3bf02031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d093bca7-6a3f-49ec-9422-c3ab3bf02031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197541059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09589d09-9fcf-4b90-a6e8-aaeb0023ce96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736862fe77e40d99134fbfc3c04f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:12Z,use_quota=True,user_id='99b111cf557e4edeac7f9ee0f657aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2fd3b2-75e1-450e-8611-fcc7a3b1b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe2fd3b2-75e1-450e-8611-fcc7a3b1b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320e837b-1bb8-4468-a901-3cdd35fc9cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320e837b-1bb8-4468-a901-3cdd35fc9cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09589d09-9fcf-4b90-a6e8-aaeb0023ce96', 'volume_name': 'volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032d2eda-618e-46ba-924c-9a182cf5985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032d2eda-618e-46ba-924c-9a182cf5985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4500815-31e6-495e-8522-f8abff8685c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:12 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Volume 09589d09-9fcf-4b90-a6e8-aaeb0023ce96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96', 'volume_size': 1} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197541059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09589d09-9fcf-4b90-a6e8-aaeb0023ce96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736862fe77e40d99134fbfc3c04f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:12Z,use_quota=True,user_id='99b111cf557e4edeac7f9ee0f657aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Creating volume 09589d09-9fcf-4b90-a6e8-aaeb0023ce96 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:52:12 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:12 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 1073741824 Nov 06 21:52:12 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:12 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 1073741824" returned: 0 in 0.524s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:12 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 Nov 06 21:52:12 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:13 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:52:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4500815-31e6-495e-8522-f8abff8685c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa918a-56cc-42c0-8949-d3e27a42edb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:13 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Volume volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 (09589d09-9fcf-4b90-a6e8-aaeb0023ce96): created successfully Nov 06 21:52:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa918a-56cc-42c0-8949-d3e27a42edb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Flow 'volume_create_manager' (dcfce715-13b9-49f3-8d21-09e480fa2df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-72ee2964-4f36-4fa4-977b-1da0f74dcd8d tempest-ProjectReaderTests-1122558381 None] Created volume successfully. Nov 06 21:52:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "cinder-09589d09-9fcf-4b90-a6e8-aaeb0023ce96-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-09589d09-9fcf-4b90-a6e8-aaeb0023ce96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "cinder-quobyte-09589d09-9fcf-4b90-a6e8-aaeb0023ce96" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-quobyte-09589d09-9fcf-4b90-a6e8-aaeb0023ce96" acquired by "delete_volume" :: waited 0.057s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c266333-fcfc-4b0e-a44d-138585904b9b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:52:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:14 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 Nov 06 21:52:14 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:15 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96" returned: 0 in 0.546s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:15 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96 Nov 06 21:52:15 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:15 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-09589d09-9fcf-4b90-a6e8-aaeb0023ce96" returned: 0 in 0.334s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-quobyte-09589d09-9fcf-4b90-a6e8-aaeb0023ce96" released by "delete_volume" :: held 0.996s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Created reservations ['b432fcb1-1af4-4692-b076-9066ac43427b', '33e72881-3a50-40f3-83c0-163d3f6c7384', 'c3d12ee1-3d36-4e0b-a4f9-a520624bbe8b', '8702bcc2-0e91-44a9-a577-8f1a9b0ccecb'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:15 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:52:15 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:16 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.409s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:16 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:52:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Deleted volume successfully. Nov 06 21:52:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6c4db603-6a12-4a55-b7b3-2522cb9bff35 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-09589d09-9fcf-4b90-a6e8-aaeb0023ce96-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Flow 'volume_create_manager' (e134e009-388d-4114-b3f3-09e1454f08bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d5e5e4-62b8-4efe-a735-e535ec263a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d5e5e4-62b8-4efe-a735-e535ec263a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141712331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8eac11-162f-4148-9deb-2c3d9573ead4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736862fe77e40d99134fbfc3c04f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:17Z,use_quota=True,user_id='99b111cf557e4edeac7f9ee0f657aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743f0903-b52e-4e2e-8964-0a4d5c3abab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743f0903-b52e-4e2e-8964-0a4d5c3abab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdc90c6-6263-452f-b140-22c7d0041960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdc90c6-6263-452f-b140-22c7d0041960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8eac11-162f-4148-9deb-2c3d9573ead4', 'volume_name': 'volume-ba8eac11-162f-4148-9deb-2c3d9573ead4', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3248e329-92f6-432e-af80-01cefcecee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3248e329-92f6-432e-af80-01cefcecee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f126fcd-6833-4f74-bfdc-dc9d158f563c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:17 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Volume ba8eac11-162f-4148-9deb-2c3d9573ead4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8eac11-162f-4148-9deb-2c3d9573ead4', 'volume_size': 1} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141712331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8eac11-162f-4148-9deb-2c3d9573ead4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4736862fe77e40d99134fbfc3c04f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:17Z,use_quota=True,user_id='99b111cf557e4edeac7f9ee0f657aa2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Creating volume ba8eac11-162f-4148-9deb-2c3d9573ead4 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:52:17 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:52:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:17 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 1073741824 Nov 06 21:52:17 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:18 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 1073741824" returned: 0 in 0.679s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:18 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 Nov 06 21:52:18 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:18 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4" returned: 0 in 0.459s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f126fcd-6833-4f74-bfdc-dc9d158f563c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8eac11-162f-4148-9deb-2c3d9573ead4', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8b6c72-5aab-49b2-859d-72927e62679c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:18 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Volume volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 (ba8eac11-162f-4148-9deb-2c3d9573ead4): created successfully Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8b6c72-5aab-49b2-859d-72927e62679c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:18 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Flow 'volume_create_manager' (e134e009-388d-4114-b3f3-09e1454f08bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2e3c854a-f4b3-46cf-933e-c363a85ac5e5 tempest-ProjectReaderTests-1122558381 None] Created volume successfully. Nov 06 21:52:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "cinder-ba8eac11-162f-4148-9deb-2c3d9573ead4-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-ba8eac11-162f-4148-9deb-2c3d9573ead4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "cinder-quobyte-ba8eac11-162f-4148-9deb-2c3d9573ead4" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-quobyte-ba8eac11-162f-4148-9deb-2c3d9573ead4" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:19 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0518626-aa26-49a9-b2b9-791ec4b7c506]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:52:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:20 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 Nov 06 21:52:20 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a14d2627-70cf-4a69-8e64-81a349c892b6 tempest-VolumesActionsTest-198523789 None] Acquiring lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340" by "attach_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a14d2627-70cf-4a69-8e64-81a349c892b6 tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340" acquired by "attach_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a14d2627-70cf-4a69-8e64-81a349c892b6 tempest-VolumesActionsTest-198523789 None] Attaching volume b2c4bb40-a04b-463d-8886-f1cd58d34340 to instance 001f9968-7138-4a3a-b8ad-1ca8eceab793 at mountpoint /dev/vdb on host None. Nov 06 21:52:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a14d2627-70cf-4a69-8e64-81a349c892b6 tempest-VolumesActionsTest-198523789 None] Attach volume completed successfully. Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a14d2627-70cf-4a69-8e64-81a349c892b6 tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340" released by "attach_volume" :: held 0.153s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:20 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4" returned: 0 in 0.506s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:20 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4 Nov 06 21:52:20 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5fe8b640-1981-4bcb-8832-31e5ba74073c tempest-VolumesActionsTest-198523789 None] Acquiring lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-detach_volume" by "detach_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5fe8b640-1981-4bcb-8832-31e5ba74073c tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5fe8b640-1981-4bcb-8832-31e5ba74073c tempest-VolumesActionsTest-198523789 None] Detaching volume b2c4bb40-a04b-463d-8886-f1cd58d34340 from instance 001f9968-7138-4a3a-b8ad-1ca8eceab793. Nov 06 21:52:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5fe8b640-1981-4bcb-8832-31e5ba74073c tempest-VolumesActionsTest-198523789 None] Detach volume completed successfully. Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5fe8b640-1981-4bcb-8832-31e5ba74073c tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:20 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ba8eac11-162f-4148-9deb-2c3d9573ead4" returned: 0 in 0.424s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-quobyte-ba8eac11-162f-4148-9deb-2c3d9573ead4" released by "delete_volume" :: held 1.014s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Created reservations ['e195b12e-df9b-4ed6-9de4-51ba29ad941b', '290eba7d-4a15-4d8a-9c0a-e6111a960550', 'f57b50e1-17c1-4c4e-94da-6d8d8ce80fc8', '8af70dcf-6c91-42d6-a657-3d07c9bc9b11'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:21 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:52:21 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:21 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.298s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:52:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Deleted volume successfully. Nov 06 21:52:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc7db9d-2e5a-432d-84be-3d21d4fa9440 tempest-ProjectReaderTests-1122558381 None] Lock "cinder-ba8eac11-162f-4148-9deb-2c3d9573ead4-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:31 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=37,cinder:INSERT=9,cinder:UPDATE=60,cinder:DELETE=4 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:52:31 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=56,cinder:SELECT=48,cinder:DELETE=6,cinder:INSERT=18 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:52:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f907e5a-fc19-41b5-8928-ed7a215ef416 tempest-VolumesActionsTest-198523789 None] Acquiring lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340" by "attach_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f907e5a-fc19-41b5-8928-ed7a215ef416 tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340" acquired by "attach_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:31 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1f907e5a-fc19-41b5-8928-ed7a215ef416 tempest-VolumesActionsTest-198523789 None] Attaching volume b2c4bb40-a04b-463d-8886-f1cd58d34340 to instance 820b03eb-a216-4a42-b80f-9d5afda62d6f at mountpoint /dev/vdb on host None. Nov 06 21:52:31 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1f907e5a-fc19-41b5-8928-ed7a215ef416 tempest-VolumesActionsTest-198523789 None] Attach volume completed successfully. Nov 06 21:52:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1f907e5a-fc19-41b5-8928-ed7a215ef416 tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340" released by "attach_volume" :: held 0.104s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-654e0d8e-64a7-4f1a-8f7a-bb9f23baef15 tempest-VolumesActionsTest-198523789 None] Acquiring lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-detach_volume" by "detach_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:52:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-654e0d8e-64a7-4f1a-8f7a-bb9f23baef15 tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:52:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-654e0d8e-64a7-4f1a-8f7a-bb9f23baef15 tempest-VolumesActionsTest-198523789 None] Detaching volume b2c4bb40-a04b-463d-8886-f1cd58d34340 from instance 820b03eb-a216-4a42-b80f-9d5afda62d6f. Nov 06 21:52:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-654e0d8e-64a7-4f1a-8f7a-bb9f23baef15 tempest-VolumesActionsTest-198523789 None] Detach volume completed successfully. Nov 06 21:52:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-654e0d8e-64a7-4f1a-8f7a-bb9f23baef15 tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:52:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6ccbd-ae4e-48d3-bd5f-d06ec9d6964f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:52:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:37 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:52:37 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:37 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.450s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:37 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fff8af-b063-440b-88c9-936e74a3be33]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:52:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:37 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:52:37 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:37 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.379s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.8fd8d0f6-d8b9-4102-be6b-ebc7c1fdfdc7_fop6dzg.img {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:37 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.8fd8d0f6-d8b9-4102-be6b-ebc7c1fdfdc7_fop6dzg.img Nov 06 21:52:37 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:42 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:INSERT=2,cinder:SELECT=6,cinder:UPDATE=4 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:52:44 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.8fd8d0f6-d8b9-4102-be6b-ebc7c1fdfdc7_fop6dzg.img" returned: 0 in 7.149s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:44 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[410dd6ed-1519-4aeb-9300-ca58d91686a1]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:52:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:45 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:52:45 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:45 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.608s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:45 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.8fd8d0f6-d8b9-4102-be6b-ebc7c1fdfdc7_fop6dzg.img {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:52:45 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Converted 1024.00 MB image at 143.21 MB/s Nov 06 21:52:45 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] 8fd8d0f6-d8b9-4102-be6b-ebc7c1fdfdc7 was raw, no need to convert to raw {{(pid=87069) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1180}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Flow 'volume_create_manager' (000c5080-0d58-4cb6-a26e-6ac178e09495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b8cda6-86c4-4c55-bbef-205d655fc491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b8cda6-86c4-4c55-bbef-205d655fc491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1312048606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6957b12-d9c1-4021-8c56-d934cad84fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d79357225654cec8298c43b2ff61a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:51Z,use_quota=True,user_id='6e2563af0e0d4bc69e7b2e9d2ef789f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad63ad1b-7d9a-47a6-94e9-905c40a75304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad63ad1b-7d9a-47a6-94e9-905c40a75304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9520d043-7064-4f4b-af06-3ab8a47b28a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9520d043-7064-4f4b-af06-3ab8a47b28a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6957b12-d9c1-4021-8c56-d934cad84fdc', 'volume_name': 'volume-e6957b12-d9c1-4021-8c56-d934cad84fdc', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b025ff-a05f-456b-a9c6-ca54fa19a5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b025ff-a05f-456b-a9c6-ca54fa19a5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c71f50d-8f80-4b09-9883-4ce0d1fbf748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Volume e6957b12-d9c1-4021-8c56-d934cad84fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6957b12-d9c1-4021-8c56-d934cad84fdc', 'volume_size': 1} Nov 06 21:52:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Flow 'volume_create_manager' (0866c3e1-5098-435c-ab53-22e9812bff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3124732-2950-485c-ab02-ea2f0c35a457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3124732-2950-485c-ab02-ea2f0c35a457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1524923236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dd7c2e-73c0-47c5-912e-5a07ff59a862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d79357225654cec8298c43b2ff61a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:51Z,use_quota=True,user_id='6e2563af0e0d4bc69e7b2e9d2ef789f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c7cc68-7e67-41b9-901c-dc3796537d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c7cc68-7e67-41b9-901c-dc3796537d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58218d92-4b34-4595-a32f-6c7a3e0c03a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58218d92-4b34-4595-a32f-6c7a3e0c03a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25dd7c2e-73c0-47c5-912e-5a07ff59a862', 'volume_name': 'volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ab2c66-973a-46fd-ad0e-056349e0987f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11ab2c66-973a-46fd-ad0e-056349e0987f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bab32a-e360-4bad-99fb-717e0d9f652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:52:51 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Volume 25dd7c2e-73c0-47c5-912e-5a07ff59a862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862', 'volume_size': 1} Nov 06 21:52:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:52:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:52:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:52:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:52:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:52:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:52:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:52:58 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:52:58 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:52:59 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Nov 06 21:52:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.498s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:52:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:52:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:52:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:52:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:53:01 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:53:01 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.637s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Uploaded volume to glance image-id: 8fd8d0f6-d8b9-4102-be6b-ebc7c1fdfdc7. {{(pid=87069) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.754s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1312048606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6957b12-d9c1-4021-8c56-d934cad84fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d79357225654cec8298c43b2ff61a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:51Z,use_quota=True,user_id='6e2563af0e0d4bc69e7b2e9d2ef789f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Creating volume e6957b12-d9c1-4021-8c56-d934cad84fdc {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:07 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:07 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc 1073741824 Nov 06 21:53:07 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:07 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0d5a9db8-055f-49ee-827e-22c652034989 tempest-VolumesActionsTest-198523789 None] Copy volume to image completed successfully. Nov 06 21:53:07 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc 1073741824" returned: 0 in 0.409s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:08 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc Nov 06 21:53:08 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:08 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc" returned: 0 in 0.259s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.145s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1524923236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dd7c2e-73c0-47c5-912e-5a07ff59a862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d79357225654cec8298c43b2ff61a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:52:51Z,use_quota=True,user_id='6e2563af0e0d4bc69e7b2e9d2ef789f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Creating volume 25dd7c2e-73c0-47c5-912e-5a07ff59a862 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:08 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c71f50d-8f80-4b09-9883-4ce0d1fbf748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6957b12-d9c1-4021-8c56-d934cad84fdc', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:08 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 1073741824 Nov 06 21:53:08 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673d8060-afa7-4900-97d8-db0f2b0fccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:08 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Volume volume-e6957b12-d9c1-4021-8c56-d934cad84fdc (e6957b12-d9c1-4021-8c56-d934cad84fdc): created successfully Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673d8060-afa7-4900-97d8-db0f2b0fccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Flow 'volume_create_manager' (000c5080-0d58-4cb6-a26e-6ac178e09495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-32cb88f1-5b8e-49c9-937d-118e75704d6c tempest-TestServerVolumeAttachmentScenario-1235755141 None] Created volume successfully. Nov 06 21:53:08 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 1073741824" returned: 0 in 0.519s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:08 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 Nov 06 21:53:08 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:09 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862" returned: 0 in 0.268s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48bab32a-e360-4bad-99fb-717e0d9f652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72216f18-f47b-4c10-978a-0b9af4929639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:09 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Volume volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 (25dd7c2e-73c0-47c5-912e-5a07ff59a862): created successfully Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72216f18-f47b-4c10-978a-0b9af4929639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Flow 'volume_create_manager' (0866c3e1-5098-435c-ab53-22e9812bff09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:09 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f02bf5cc-d2ec-43af-8ec0-b89b2a57b660 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Created volume successfully. Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[496f8c6e-80b8-4d35-a491-7bd7894c94cc]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:09 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:53:09 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:09 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.369s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[35749a86-f83a-41ca-bfab-d8a24034c812]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:09 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:53:09 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:10 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.372s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:10 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img Nov 06 21:53:10 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:16 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img" returned: 0 in 6.341s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ab35f3-b65e-49be-bd60-2f6c78f6d14d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:16 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:53:16 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:16 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.517s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:16 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:53:16 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Converted 1024.00 MB image at 161.42 MB/s Nov 06 21:53:16 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] ab98f9c7-31d4-43d1-935d-a35aac3ccb63 was raw, converting to qcow2 {{(pid=87069) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1197}} Nov 06 21:53:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b0a86-ccb2-4122-aab1-aef1a2ac6ec7]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:17 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img Nov 06 21:53:17 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:17 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img" returned: 0 in 0.313s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:17 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img Nov 06 21:53:17 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:17 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img" returned: 1 in 0.306s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img /opt/stack/data/cinder/conversion/vol_upload__qmcbm0v {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:17 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img /opt/stack/data/cinder/conversion/vol_upload__qmcbm0v Nov 06 21:53:17 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:17 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img /opt/stack/data/cinder/conversion/vol_upload__qmcbm0v" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Image conversion details: src /opt/stack/data/cinder/conversion/b2c4bb40-a04b-463d-8886-f1cd58d34340.temp_image.ab98f9c7-31d4-43d1-935d-a35aac3ccb635_me2345.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__qmcbm0v {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:53:17 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b387499a-2b0a-4d0a-a1ff-0b5c9adf3ef3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__qmcbm0v {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:17 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__qmcbm0v Nov 06 21:53:17 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:18 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__qmcbm0v" returned: 0 in 0.312s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.120s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Uploaded volume to glance image-id: ab98f9c7-31d4-43d1-935d-a35aac3ccb63. {{(pid=87069) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 21:53:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c42cae50-10c7-46cc-a890-99d0543a6d66 tempest-VolumesActionsTest-198523789 None] Copy volume to image completed successfully. Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Acquiring lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Acquiring lock "cinder-quobyte-b2c4bb40-a04b-463d-8886-f1cd58d34340" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Lock "cinder-quobyte-b2c4bb40-a04b-463d-8886-f1cd58d34340" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd168add-3da2-48b6-af98-ca69ca6d884d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:20 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:53:20 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:20 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.352s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:20 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340 Nov 06 21:53:20 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:20 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b2c4bb40-a04b-463d-8886-f1cd58d34340" returned: 0 in 0.238s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Lock "cinder-quobyte-b2c4bb40-a04b-463d-8886-f1cd58d34340" released by "delete_volume" :: held 0.631s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Created reservations ['7b4d8ffe-e842-453f-b333-def34bf8e749', 'b26189a1-166f-4c5d-9bc5-beee3166db40', '3c68a750-68e5-4a11-be3f-078903795b8e', 'dae97679-6d09-490a-b4fc-5d162bfe547a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:21 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:53:21 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:21 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.236s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:53:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Deleted volume successfully. Nov 06 21:53:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-cfce2eab-70e7-41ab-9dc5-0759f55d7e23 tempest-VolumesActionsTest-198523789 None] Lock "cinder-b2c4bb40-a04b-463d-8886-f1cd58d34340-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-cab16513-1fd4-40e5-867a-5133fcbe4bd3 req-00e2dd81-8c5d-443f-bbdc-31091a8a382d tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-cab16513-1fd4-40e5-867a-5133fcbe4bd3 req-00e2dd81-8c5d-443f-bbdc-31091a8a382d tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-cab16513-1fd4-40e5-867a-5133fcbe4bd3 req-00e2dd81-8c5d-443f-bbdc-31091a8a382d tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-cab16513-1fd4-40e5-867a-5133fcbe4bd3 req-00e2dd81-8c5d-443f-bbdc-31091a8a382d tempest-TestServerVolumeAttachmentScenario-1235755141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-e6957b12-d9c1-4021-8c56-d934cad84fdc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e9bebad-43f5-423e-8c04-cf0a67a90506', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:53:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-cab16513-1fd4-40e5-867a-5133fcbe4bd3 req-00e2dd81-8c5d-443f-bbdc-31091a8a382d tempest-TestServerVolumeAttachmentScenario-1235755141 None] attachment_update completed successfully. Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-aa8a6acc-b4f4-44e3-bfdd-db5b681f7ca5 req-8965a56e-5002-46ae-94d9-663923f3ffe5 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-aa8a6acc-b4f4-44e3-bfdd-db5b681f7ca5 req-8965a56e-5002-46ae-94d9-663923f3ffe5 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-aa8a6acc-b4f4-44e3-bfdd-db5b681f7ca5 req-8965a56e-5002-46ae-94d9-663923f3ffe5 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Flow 'volume_create_manager' (26c7d49a-acd7-4db2-8506-cd82960a3605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc6bad1-13b0-45af-9c0f-fa6f4bea241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dc6bad1-13b0-45af-9c0f-fa6f4bea241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1461810461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d90881-58b1-4e74-a661-45818975b292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e35a10a1c04b33997eaaa39c595db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:29Z,use_quota=True,user_id='70e912740432496ebbe51a5d3a7d8c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be8da49-8483-4f0d-a77d-8d7c567f86b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be8da49-8483-4f0d-a77d-8d7c567f86b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ce63b1-71bd-4068-b78b-b530bacb238a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4ce63b1-71bd-4068-b78b-b530bacb238a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d90881-58b1-4e74-a661-45818975b292', 'volume_name': 'volume-64d90881-58b1-4e74-a661-45818975b292', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a41f723-ddb4-4e35-ab90-a12117a1518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a41f723-ddb4-4e35-ab90-a12117a1518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84d0eb4-64f8-470a-b74e-ccae1c8a08eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:28 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Volume 64d90881-58b1-4e74-a661-45818975b292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d90881-58b1-4e74-a661-45818975b292', 'volume_size': 1} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1461810461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d90881-58b1-4e74-a661-45818975b292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e35a10a1c04b33997eaaa39c595db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:29Z,use_quota=True,user_id='70e912740432496ebbe51a5d3a7d8c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Creating volume 64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:28 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-aa8a6acc-b4f4-44e3-bfdd-db5b681f7ca5 req-8965a56e-5002-46ae-94d9-663923f3ffe5 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b1c7616-b17b-40de-be58-d4c5bcb04301', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:53:29 devstack sudo[103890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 1073741824 Nov 06 21:53:29 devstack sudo[103890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:29 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-aa8a6acc-b4f4-44e3-bfdd-db5b681f7ca5 req-8965a56e-5002-46ae-94d9-663923f3ffe5 tempest-TestServerVolumeAttachmentScenario-1235755141 None] attachment_update completed successfully. Nov 06 21:53:29 devstack sudo[103890]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 1073741824" returned: 0 in 0.513s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:29 devstack sudo[103899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 Nov 06 21:53:29 devstack sudo[103899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:29 devstack sudo[103899]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292" returned: 0 in 0.274s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d84d0eb4-64f8-470a-b74e-ccae1c8a08eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d90881-58b1-4e74-a661-45818975b292', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19acf5de-62b6-4dcd-b062-35d03e20f8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:29 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Volume volume-64d90881-58b1-4e74-a661-45818975b292 (64d90881-58b1-4e74-a661-45818975b292): created successfully Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19acf5de-62b6-4dcd-b062-35d03e20f8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Flow 'volume_create_manager' (26c7d49a-acd7-4db2-8506-cd82960a3605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:29 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-45ea10b3-2902-4b04-9f35-d6f0b2315544 tempest-VolumesCloneTest-339175699 None] Created volume successfully. Nov 06 21:53:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-ddb7fa57-8783-4a5d-a726-aa80cbaa3a6b req-db01beb1-5e82-43c1-90d6-886c70c901ed tempest-TestServerVolumeAttachmentScenario-1235755141 None] Terminate volume connection completed successfully. Nov 06 21:53:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-ddb7fa57-8783-4a5d-a726-aa80cbaa3a6b req-db01beb1-5e82-43c1-90d6-886c70c901ed tempest-TestServerVolumeAttachmentScenario-1235755141 None] Deleting attachment 9b1c7616-b17b-40de-be58-d4c5bcb04301. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Flow 'volume_create_manager' (467e3c1b-49bb-4a1c-86e9-fe0fff55056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd7c516-3120-4802-8a3d-399314a5c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd7c516-3120-4802-8a3d-399314a5c455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-682943386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82394a48-fa6d-45ca-b5fd-3250e1651969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e35a10a1c04b33997eaaa39c595db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=64d90881-58b1-4e74-a661-45818975b292,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:31Z,use_quota=True,user_id='70e912740432496ebbe51a5d3a7d8c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793305a2-b0e7-44ea-8dcd-bd97e2c75844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793305a2-b0e7-44ea-8dcd-bd97e2c75844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d923ec7d-56a0-4e0c-ab67-334f3f65a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d923ec7d-56a0-4e0c-ab67-334f3f65a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '82394a48-fa6d-45ca-b5fd-3250e1651969', 'volume_name': 'volume-82394a48-fa6d-45ca-b5fd-3250e1651969', 'volume_size': 2, 'source_volid': '64d90881-58b1-4e74-a661-45818975b292', 'source_volstatus': 'available'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c50c7e-982d-46eb-8c95-5a7469af39f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c50c7e-982d-46eb-8c95-5a7469af39f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c86f099-91e9-445e-87c2-727cd5481719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Volume 82394a48-fa6d-45ca-b5fd-3250e1651969: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-82394a48-fa6d-45ca-b5fd-3250e1651969', 'volume_size': 2, 'source_volid': '64d90881-58b1-4e74-a661-45818975b292', 'source_volstatus': 'available'} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:31 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Cloning volume 64d90881-58b1-4e74-a661-45818975b292 to volume 82394a48-fa6d-45ca-b5fd-3250e1651969 Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Creating offline snapshot c21dc945-b364-456d-a1f7-cdeabde28c4d of volume 64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3d9747-3028-48b1-9317-91cb945ef947]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:31 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 Nov 06 21:53:31 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-0b03c8c0-fe36-40ce-a0d6-690b87816140 req-86042219-ab42-4179-8e0a-5d2490e0564e tempest-TestServerVolumeAttachmentScenario-1235755141 None] Terminate volume connection completed successfully. Nov 06 21:53:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-0b03c8c0-fe36-40ce-a0d6-690b87816140 req-86042219-ab42-4179-8e0a-5d2490e0564e tempest-TestServerVolumeAttachmentScenario-1235755141 None] Deleting attachment 8e9bebad-43f5-423e-8c04-cf0a67a90506. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:53:32 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292" returned: 0 in 0.407s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:32 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d 1G Nov 06 21:53:32 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:32 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d 1G" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d90881-58b1-4e74-a661-45818975b292 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:32 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d90881-58b1-4e74-a661-45818975b292 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d Nov 06 21:53:32 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:32 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64d90881-58b1-4e74-a661-45818975b292 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d" returned: 0 in 0.309s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:32 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d is being set with open permissions: ugo+rw Nov 06 21:53:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:32 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d Nov 06 21:53:32 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:33 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d" returned: 0 in 0.262s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:33 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.info Nov 06 21:53:33 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:33 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.info" returned: 0 in 0.277s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:33 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.info is being set with open permissions: ugo+rw Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:33 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.info Nov 06 21:53:33 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:33 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.info" returned: 0 in 0.330s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Acquiring lock "cinder-quobyte-82394a48-fa6d-45ca-b5fd-3250e1651969" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Lock "cinder-quobyte-82394a48-fa6d-45ca-b5fd-3250e1651969" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] snapshot: c21dc945-b364-456d-a1f7-cdeabde28c4d, volume: 82394a48-fa6d-45ca-b5fd-3250e1651969, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef88bf55-bfeb-4106-aa34-9c3fdfe53540]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:33 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d Nov 06 21:53:33 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:34 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d" returned: 0 in 0.383s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64d90881-58b1-4e74-a661-45818975b292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[920b7aab-14e4-45a3-bcaf-84a344bb7a16]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:34 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 Nov 06 21:53:34 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:34 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:53:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:34 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 Nov 06 21:53:34 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "cinder-25dd7c2e-73c0-47c5-912e-5a07ff59a862-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "cinder-25dd7c2e-73c0-47c5-912e-5a07ff59a862-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "cinder-quobyte-25dd7c2e-73c0-47c5-912e-5a07ff59a862" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "cinder-quobyte-25dd7c2e-73c0-47c5-912e-5a07ff59a862" acquired by "delete_volume" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:37 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[402308f2-2ca8-4bb4-a72e-3c6d970cc8b0]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:37 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 Nov 06 21:53:37 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:37 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862" returned: 0 in 0.493s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:37 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862 Nov 06 21:53:37 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:38 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-25dd7c2e-73c0-47c5-912e-5a07ff59a862" returned: 0 in 0.419s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "cinder-quobyte-25dd7c2e-73c0-47c5-912e-5a07ff59a862" released by "delete_volume" :: held 0.990s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Created reservations ['7c578b20-defb-429d-ad61-a18c0f21bfc3', '3eb0aa54-3c5d-4aa6-b48b-5308ed2f49dd', 'a3c3e9c8-d367-4674-bf45-afdd58f731b2', '5390a8e5-d68e-43cc-83f3-f72b82c871af'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:38 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:53:38 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:38 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.359s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:53:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Deleted volume successfully. Nov 06 21:53:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6d7d862d-13d5-4820-8a2f-69f98b562de7 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "cinder-25dd7c2e-73c0-47c5-912e-5a07ff59a862-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "cinder-e6957b12-d9c1-4021-8c56-d934cad84fdc-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "cinder-e6957b12-d9c1-4021-8c56-d934cad84fdc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "cinder-quobyte-e6957b12-d9c1-4021-8c56-d934cad84fdc" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "cinder-quobyte-e6957b12-d9c1-4021-8c56-d934cad84fdc" acquired by "delete_volume" :: waited 0.042s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:39 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea429c0-936e-4705-a5e9-f36984eee426]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:39 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc Nov 06 21:53:39 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:40 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc" returned: 0 in 0.627s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:40 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc Nov 06 21:53:40 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:40 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e6957b12-d9c1-4021-8c56-d934cad84fdc" returned: 0 in 0.439s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "cinder-quobyte-e6957b12-d9c1-4021-8c56-d934cad84fdc" released by "delete_volume" :: held 1.160s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Created reservations ['53b9bd0f-b8aa-47a1-8560-054f31cf5012', '3673ddcc-c794-4dbe-ac28-3b8f413d7454', '92c66077-8fb6-4903-aa80-54ce28198ec3', '12ab1866-b7d4-444c-ade1-0428fbd981db'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:41 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:53:41 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:41 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.497s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:53:41 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Deleted volume successfully. Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dadc2007-76ee-4ff5-ad52-c34cd29afdf9 tempest-TestServerVolumeAttachmentScenario-1235755141 None] Lock "cinder-e6957b12-d9c1-4021-8c56-d934cad84fdc-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:41 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969" returned: 0 in 7.040s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292, size 1024.00 MB, duration 7.04 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:53:41 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Converted 1024.00 MB image at 145.44 MB/s Nov 06 21:53:41 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 is being set with open permissions: ugo+rw Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:41 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 Nov 06 21:53:41 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:41 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Lock "cinder-quobyte-82394a48-fa6d-45ca-b5fd-3250e1651969" released by "_copy_volume_from_snapshot" :: held 8.128s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Acquiring lock "cinder-quobyte-c21dc945-b364-456d-a1f7-cdeabde28c4d" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Lock "cinder-quobyte-c21dc945-b364-456d-a1f7-cdeabde28c4d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Deleting offline snapshot c21dc945-b364-456d-a1f7-cdeabde28c4d of volume 64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] snapshot_file for this snap is: volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e48f3b-5c94-447f-914e-1a59a1358764]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:42 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d Nov 06 21:53:42 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:42 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d" returned: 0 in 0.391s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64d90881-58b1-4e74-a661-45818975b292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:53:42 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1360479-a958-4789-9d69-892349e97347]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:42 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 Nov 06 21:53:42 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:42 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292" returned: 0 in 0.551s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:42 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d Nov 06 21:53:42 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:43 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:43 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d Nov 06 21:53:43 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:43 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292.c21dc945-b364-456d-a1f7-cdeabde28c4d" returned: 0 in 0.257s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Lock "cinder-quobyte-c21dc945-b364-456d-a1f7-cdeabde28c4d" released by "_delete_snapshot" :: held 1.662s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c86f099-91e9-445e-87c2-727cd5481719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82394a48-fa6d-45ca-b5fd-3250e1651969', 'volume_size': 2, 'source_volid': '64d90881-58b1-4e74-a661-45818975b292', 'source_volstatus': 'available'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5327be03-47c3-4c9e-bdaf-d771fe4ee495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:43 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Volume volume-82394a48-fa6d-45ca-b5fd-3250e1651969 (82394a48-fa6d-45ca-b5fd-3250e1651969): created successfully Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5327be03-47c3-4c9e-bdaf-d771fe4ee495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:43 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Flow 'volume_create_manager' (467e3c1b-49bb-4a1c-86e9-fe0fff55056b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ac468194-4908-4dc6-82f9-d5a87a0da315 tempest-VolumesCloneTest-339175699 None] Created volume successfully. Nov 06 21:53:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Acquiring lock "cinder-82394a48-fa6d-45ca-b5fd-3250e1651969-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Lock "cinder-82394a48-fa6d-45ca-b5fd-3250e1651969-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Acquiring lock "cinder-quobyte-82394a48-fa6d-45ca-b5fd-3250e1651969" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Lock "cinder-quobyte-82394a48-fa6d-45ca-b5fd-3250e1651969" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:44 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a683500-893c-448e-92bd-5c4b8ed9d889]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:44 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 Nov 06 21:53:44 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:45 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969" returned: 0 in 0.417s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:45 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969 Nov 06 21:53:45 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:45 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-82394a48-fa6d-45ca-b5fd-3250e1651969" returned: 0 in 0.252s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Lock "cinder-quobyte-82394a48-fa6d-45ca-b5fd-3250e1651969" released by "delete_volume" :: held 0.735s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Created reservations ['b42ae718-f19c-419f-9880-5d02ab7c44d8', 'f749342b-6851-43f1-92e1-228a1b20b1c3', '14f08e3a-337d-4247-ae17-683ef5bdde4e', '3077e503-e01f-4c11-9ccb-8743aeee9e66'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:45 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:53:45 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:45 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.278s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:53:45 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Deleted volume successfully. Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Acquiring lock "cinder-64d90881-58b1-4e74-a661-45818975b292-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Lock "cinder-64d90881-58b1-4e74-a661-45818975b292-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ab3a5328-99c0-46a3-8087-c7cd88503fb2 tempest-VolumesCloneTest-339175699 None] Lock "cinder-82394a48-fa6d-45ca-b5fd-3250e1651969-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Acquiring lock "cinder-quobyte-64d90881-58b1-4e74-a661-45818975b292" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Lock "cinder-quobyte-64d90881-58b1-4e74-a661-45818975b292" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eebd2f-9d9c-4fb3-b17f-caf1ea6cce93]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:46 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 Nov 06 21:53:46 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:46 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:46 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292 Nov 06 21:53:46 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:46 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-64d90881-58b1-4e74-a661-45818975b292" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Lock "cinder-quobyte-64d90881-58b1-4e74-a661-45818975b292" released by "delete_volume" :: held 0.731s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Created reservations ['b5b13049-0c15-4168-8b49-905220368ce4', '7111ca24-f12f-4d3e-81c7-d8338a7a5f4e', '6654d686-ff47-4952-9cce-31bbe7c21726', 'bbd4e052-9a64-4492-9c0f-3471140e3aa9'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:46 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:53:46 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:47 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.260s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:47 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:53:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Deleted volume successfully. Nov 06 21:53:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-52cf8898-498e-4637-9007-820de6b141f8 tempest-VolumesCloneTest-339175699 None] Lock "cinder-64d90881-58b1-4e74-a661-45818975b292-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Flow 'volume_create_manager' (abdd5962-748f-4b09-8577-a2160b0e7d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a723585-7ba1-4bcd-8e07-4d7cdccf8799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a723585-7ba1-4bcd-8e07-4d7cdccf8799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1799055522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd23801-9bf9-43c6-9568-cf9e797476ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27b463116b2421ebf7f8697443b050c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:51Z,use_quota=True,user_id='47d7780330364781863fec6c62be13fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1220c8e5-c49e-4f60-a17e-19283e2e03ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1220c8e5-c49e-4f60-a17e-19283e2e03ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aff1654-6fc0-4871-bdb8-6400457a20a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aff1654-6fc0-4871-bdb8-6400457a20a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd23801-9bf9-43c6-9568-cf9e797476ab', 'volume_name': 'volume-bdd23801-9bf9-43c6-9568-cf9e797476ab', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041c46ec-fede-4416-a607-54c480052ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041c46ec-fede-4416-a607-54c480052ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b99f54-d57b-44a8-ac74-53edbb3cb663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Volume bdd23801-9bf9-43c6-9568-cf9e797476ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd23801-9bf9-43c6-9568-cf9e797476ab', 'volume_size': 1} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1799055522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd23801-9bf9-43c6-9568-cf9e797476ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27b463116b2421ebf7f8697443b050c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:51Z,use_quota=True,user_id='47d7780330364781863fec6c62be13fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Creating volume bdd23801-9bf9-43c6-9568-cf9e797476ab {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:50 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:50 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab 1073741824 Nov 06 21:53:50 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:51 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab 1073741824" returned: 0 in 0.445s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:51 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab Nov 06 21:53:51 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:51 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab" returned: 0 in 0.280s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b99f54-d57b-44a8-ac74-53edbb3cb663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd23801-9bf9-43c6-9568-cf9e797476ab', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2685ce2-c748-488b-ac5e-1a645373e4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:51 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Volume volume-bdd23801-9bf9-43c6-9568-cf9e797476ab (bdd23801-9bf9-43c6-9568-cf9e797476ab): created successfully Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2685ce2-c748-488b-ac5e-1a645373e4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Flow 'volume_create_manager' (abdd5962-748f-4b09-8577-a2160b0e7d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:51 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c6bc4b0c-de93-44c8-9717-eac96c6f74e7 tempest-VolumesNegativeTest-1866794614 None] Created volume successfully. Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (b3827e7d-1328-42ad-be53-dd5e303ab95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4940ad-466b-4e89-bebe-5838922196de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4940ad-466b-4e89-bebe-5838922196de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-541763702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d282793-1054-49a3-8942-1687402aebcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:53Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03950480-8e1f-4b88-a520-05064714ad9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03950480-8e1f-4b88-a520-05064714ad9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e9f75e-8736-415c-80f7-ce5bc8b4316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e9f75e-8736-415c-80f7-ce5bc8b4316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d282793-1054-49a3-8942-1687402aebcc', 'volume_name': 'volume-6d282793-1054-49a3-8942-1687402aebcc', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230f4655-b7d5-48fb-bdbb-5f48400900bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230f4655-b7d5-48fb-bdbb-5f48400900bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c821a6e-8e1e-4d88-9cd7-36ee5639ef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Volume 6d282793-1054-49a3-8942-1687402aebcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d282793-1054-49a3-8942-1687402aebcc', 'volume_size': 1} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-541763702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d282793-1054-49a3-8942-1687402aebcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:53Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Creating volume 6d282793-1054-49a3-8942-1687402aebcc {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:53 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:53 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc 1073741824 Nov 06 21:53:53 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (8a0feaed-89eb-44bc-907f-6866fb868b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91272843-c94e-4d72-8e4e-f4d52f73673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91272843-c94e-4d72-8e4e-f4d52f73673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223376738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd98cdf9-6098-45c3-8ea3-858e0307460a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:54Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460253a3-4965-4d72-9edb-7bc439b8af1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460253a3-4965-4d72-9edb-7bc439b8af1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ac120a-237d-48d6-b748-a3b50ba5a699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ac120a-237d-48d6-b748-a3b50ba5a699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd98cdf9-6098-45c3-8ea3-858e0307460a', 'volume_name': 'volume-cd98cdf9-6098-45c3-8ea3-858e0307460a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9dda54-c03e-4b1a-83a1-59a05710dfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9dda54-c03e-4b1a-83a1-59a05710dfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b527d3-f995-45c5-9942-640b0240c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Volume cd98cdf9-6098-45c3-8ea3-858e0307460a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd98cdf9-6098-45c3-8ea3-858e0307460a', 'volume_size': 1} Nov 06 21:53:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:53:54 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (40085c61-70bc-4459-af9c-d5636624553a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab7e38a-1735-440c-91ec-0f69da503c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc 1073741824" returned: 0 in 0.664s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab7e38a-1735-440c-91ec-0f69da503c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-84143737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14c3073-a563-46e1-a89f-44df328ac45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:54Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1be5bc-5875-42fb-98f4-ca0670eebad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1be5bc-5875-42fb-98f4-ca0670eebad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135ced93-e2e6-4e9b-b5a5-9550dfbbfe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (135ced93-e2e6-4e9b-b5a5-9550dfbbfe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14c3073-a563-46e1-a89f-44df328ac45c', 'volume_name': 'volume-f14c3073-a563-46e1-a89f-44df328ac45c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3291ac12-47bc-4fbd-8f50-4361e045d502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3291ac12-47bc-4fbd-8f50-4361e045d502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8e946c-11fc-49e5-a87e-a485c23fe56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Volume f14c3073-a563-46e1-a89f-44df328ac45c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14c3073-a563-46e1-a89f-44df328ac45c', 'volume_size': 1} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:54 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc Nov 06 21:53:54 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:54 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc" returned: 0 in 0.309s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223376738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd98cdf9-6098-45c3-8ea3-858e0307460a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:54Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Creating volume cd98cdf9-6098-45c3-8ea3-858e0307460a {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:54 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:54 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a 1073741824 Nov 06 21:53:54 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c821a6e-8e1e-4d88-9cd7-36ee5639ef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d282793-1054-49a3-8942-1687402aebcc', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c012b3-2997-459d-bb6c-a1d9d7d26154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (a8f6f70a-4671-44a2-84bc-db4f08bcd410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b523b5ba-f62b-49d5-a5f9-e6a720190c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Volume volume-6d282793-1054-49a3-8942-1687402aebcc (6d282793-1054-49a3-8942-1687402aebcc): created successfully Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c012b3-2997-459d-bb6c-a1d9d7d26154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (b3827e7d-1328-42ad-be53-dd5e303ab95b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b523b5ba-f62b-49d5-a5f9-e6a720190c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-349341086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f6860-e2f9-4f14-8529-6ffbf110ed86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:55Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c217df86-0af0-46c7-98eb-41e2e677e849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c217df86-0af0-46c7-98eb-41e2e677e849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd285eb-0301-4da0-8ced-918d6c9fd090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:54 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd285eb-0301-4da0-8ced-918d6c9fd090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7f6860-e2f9-4f14-8529-6ffbf110ed86', 'volume_name': 'volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fe7ec2-58cb-467b-b489-34acaf079600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23fe7ec2-58cb-467b-b489-34acaf079600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27a3657-6059-4866-9d7e-d15f6a45c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:55 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Volume 1f7f6860-e2f9-4f14-8529-6ffbf110ed86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86', 'volume_size': 1} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:55 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9964f761-3ba8-41ce-94cb-cc08b9822d16 tempest-CreateVolumesFromImageTest-64847206 None] Created volume successfully. Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (52035033-8e3b-4c6d-bd21-7a8d8293432a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69a1610-9a31-478f-858d-70ec8e2759e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69a1610-9a31-478f-858d-70ec8e2759e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-50531367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b02128-7578-4ab0-a1c2-360bf62f8d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:55Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8481e847-7c3a-4fb3-9462-5be74d2e8f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8481e847-7c3a-4fb3-9462-5be74d2e8f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08cfa446-384c-475e-ba6d-320aa6f05847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:55 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08cfa446-384c-475e-ba6d-320aa6f05847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b02128-7578-4ab0-a1c2-360bf62f8d77', 'volume_name': 'volume-12b02128-7578-4ab0-a1c2-360bf62f8d77', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd372164-7013-4a80-833f-89cc7bd01768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd372164-7013-4a80-833f-89cc7bd01768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d83d128-b615-496b-94e9-31ca5945c4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:55 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Volume 12b02128-7578-4ab0-a1c2-360bf62f8d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b02128-7578-4ab0-a1c2-360bf62f8d77', 'volume_size': 1} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a 1073741824" returned: 0 in 0.649s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:55 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a Nov 06 21:53:55 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:55 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a" returned: 0 in 0.275s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.391s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-84143737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14c3073-a563-46e1-a89f-44df328ac45c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:54Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Creating volume f14c3073-a563-46e1-a89f-44df328ac45c {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:55 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b527d3-f995-45c5-9942-640b0240c408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd98cdf9-6098-45c3-8ea3-858e0307460a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:55 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c 1073741824 Nov 06 21:53:55 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d18e2f7-9e74-4899-a321-482a5c01a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:55 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Volume volume-cd98cdf9-6098-45c3-8ea3-858e0307460a (cd98cdf9-6098-45c3-8ea3-858e0307460a): created successfully Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d18e2f7-9e74-4899-a321-482a5c01a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (8a0feaed-89eb-44bc-907f-6866fb868b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:55 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-18c89e78-a211-48ad-a8d1-d6ad5b0736a2 tempest-CreateVolumesFromImageTest-64847206 None] Created volume successfully. Nov 06 21:53:56 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c 1073741824" returned: 0 in 0.508s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:56 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c Nov 06 21:53:56 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:56 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c" returned: 0 in 0.297s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-349341086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f6860-e2f9-4f14-8529-6ffbf110ed86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:55Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Creating volume 1f7f6860-e2f9-4f14-8529-6ffbf110ed86 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:56 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:56 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 1073741824 Nov 06 21:53:56 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8e946c-11fc-49e5-a87e-a485c23fe56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14c3073-a563-46e1-a89f-44df328ac45c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227e3539-8b5b-420b-a7d1-017580279211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:56 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Volume volume-f14c3073-a563-46e1-a89f-44df328ac45c (f14c3073-a563-46e1-a89f-44df328ac45c): created successfully Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (227e3539-8b5b-420b-a7d1-017580279211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (40085c61-70bc-4459-af9c-d5636624553a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8719a152-de13-4a6b-9be3-b3da714f3658 tempest-CreateVolumesFromImageTest-64847206 None] Created volume successfully. Nov 06 21:53:57 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 1073741824" returned: 0 in 0.427s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:57 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 Nov 06 21:53:57 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:57 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-50531367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b02128-7578-4ab0-a1c2-360bf62f8d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='381e571180f844ee8ca0b2543dce17df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:53:55Z,use_quota=True,user_id='42a58566260e4412b638f4ee2c5aad1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Creating volume 12b02128-7578-4ab0-a1c2-360bf62f8d77 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:53:57 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:57 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 1073741824 Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27a3657-6059-4866-9d7e-d15f6a45c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:57 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488b7f69-9ca7-447f-a190-f1611132d234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:57 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Volume volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 (1f7f6860-e2f9-4f14-8529-6ffbf110ed86): created successfully Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488b7f69-9ca7-447f-a190-f1611132d234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (a8f6f70a-4671-44a2-84bc-db4f08bcd410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:57 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-353d15b6-e4b1-4828-951b-c7c37412a3c1 tempest-CreateVolumesFromImageTest-64847206 None] Created volume successfully. Nov 06 21:53:58 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 1073741824" returned: 0 in 0.712s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:58 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 Nov 06 21:53:58 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:58 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77" returned: 0 in 0.361s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d83d128-b615-496b-94e9-31ca5945c4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b02128-7578-4ab0-a1c2-360bf62f8d77', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c8bf41-792e-4673-905d-dcceb6abca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:53:58 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Volume volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 (12b02128-7578-4ab0-a1c2-360bf62f8d77): created successfully Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c8bf41-792e-4673-905d-dcceb6abca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Flow 'volume_create_manager' (52035033-8e3b-4c6d-bd21-7a8d8293432a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:53:58 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-3c8e1c15-17e2-45db-a008-b98c7a8ec4ee tempest-CreateVolumesFromImageTest-64847206 None] Created volume successfully. Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:58 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:53:58 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-12b02128-7578-4ab0-a1c2-360bf62f8d77-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-12b02128-7578-4ab0-a1c2-360bf62f8d77-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-quobyte-12b02128-7578-4ab0-a1c2-360bf62f8d77" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:53:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-12b02128-7578-4ab0-a1c2-360bf62f8d77" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e2ae8f-8f7c-451f-8d43-2cfc8557df76]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:59 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.365s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:53:59 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 Nov 06 21:53:59 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:59 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77" returned: 0 in 0.506s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:59 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77 Nov 06 21:53:59 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:53:59 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-12b02128-7578-4ab0-a1c2-360bf62f8d77" returned: 0 in 0.256s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-12b02128-7578-4ab0-a1c2-360bf62f8d77" released by "delete_volume" :: held 0.854s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Created reservations ['63d2eaa8-5224-49eb-bf25-ecb89604a08a', 'ef930ff3-2bb6-456c-9cbb-e468512034e7', 'c5cd3368-cb17-4ca6-bbe9-396b8e3bb729', 'f5a3896e-10b3-44ce-bcf3-56edf47d6b7d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:53:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:53:59 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:53:59 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-1f7f6860-e2f9-4f14-8529-6ffbf110ed86-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-1f7f6860-e2f9-4f14-8529-6ffbf110ed86-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-quobyte-1f7f6860-e2f9-4f14-8529-6ffbf110ed86" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-1f7f6860-e2f9-4f14-8529-6ffbf110ed86" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[488e7cca-e768-45c3-9785-181c2592415e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:00 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.331s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:00 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Deleted volume successfully. Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e5b522aa-f49c-44b3-92c2-cc3975cc6728 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-12b02128-7578-4ab0-a1c2-360bf62f8d77-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:00 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 Nov 06 21:54:00 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:00 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86" returned: 0 in 0.465s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:00 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86 Nov 06 21:54:00 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:00 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1f7f6860-e2f9-4f14-8529-6ffbf110ed86" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-1f7f6860-e2f9-4f14-8529-6ffbf110ed86" released by "delete_volume" :: held 0.800s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Created reservations ['95dfe652-6215-48ef-8e51-ee138f7aff4d', '290a0be9-c795-406d-a474-2ff17d531082', '2d2a77f4-1c04-444b-8cd1-c40baf5fc746', '89767205-3392-4307-8661-598b41ccbecc'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=64,cinder:UPDATE=85,cinder:DELETE=11,cinder:INSERT=22 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=89,cinder:SELECT=83,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:01 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:01 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-f14c3073-a563-46e1-a89f-44df328ac45c-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-f14c3073-a563-46e1-a89f-44df328ac45c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-quobyte-f14c3073-a563-46e1-a89f-44df328ac45c" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-f14c3073-a563-46e1-a89f-44df328ac45c" acquired by "delete_volume" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ff6a1a-74cd-4238-89a1-2b797793a432]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:01 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.342s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:01 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Deleted volume successfully. Nov 06 21:54:01 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c Nov 06 21:54:01 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-33636912-cc75-4d1c-aedc-bfa128e39f62 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-1f7f6860-e2f9-4f14-8529-6ffbf110ed86-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:01 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c" returned: 0 in 0.474s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:01 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c Nov 06 21:54:01 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:02 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f14c3073-a563-46e1-a89f-44df328ac45c" returned: 0 in 0.312s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-f14c3073-a563-46e1-a89f-44df328ac45c" released by "delete_volume" :: held 0.861s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Created reservations ['678884a4-2749-4fc3-b959-d0fd140fef6b', '9fb12523-e893-40b1-9c64-b822607b973e', 'ee73928e-a832-4ceb-95c3-27d5b15bd0fa', 'dfc5d3c1-25be-42b9-aa4d-cd656fd69375'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:02 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:02 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-cd98cdf9-6098-45c3-8ea3-858e0307460a-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-cd98cdf9-6098-45c3-8ea3-858e0307460a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-quobyte-cd98cdf9-6098-45c3-8ea3-858e0307460a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-cd98cdf9-6098-45c3-8ea3-858e0307460a" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b433ed1-d4ec-4f8c-a621-e6420d873761]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:02 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.309s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Deleted volume successfully. Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f33dbe2-d016-4654-ad21-867adc69d281 tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-f14c3073-a563-46e1-a89f-44df328ac45c-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:02 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a Nov 06 21:54:02 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:02 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a" returned: 0 in 0.362s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:03 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a Nov 06 21:54:03 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:03 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cd98cdf9-6098-45c3-8ea3-858e0307460a" returned: 0 in 0.253s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-cd98cdf9-6098-45c3-8ea3-858e0307460a" released by "delete_volume" :: held 0.670s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Created reservations ['7bbaad06-8f87-478a-be53-c407757b81bf', '757356c8-3202-416c-b2ac-91b465a3b6cb', '0758d09d-ff62-4ca7-b4a8-ae082918ca37', 'faabd395-c354-4920-a07b-8e3ce96c8fe6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:03 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:03 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:03 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Deleted volume successfully. Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-6d282793-1054-49a3-8942-1687402aebcc-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-454add5d-3149-4b8c-ae6d-788a41f1f18c tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-cd98cdf9-6098-45c3-8ea3-858e0307460a-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-6d282793-1054-49a3-8942-1687402aebcc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "cinder-quobyte-6d282793-1054-49a3-8942-1687402aebcc" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-6d282793-1054-49a3-8942-1687402aebcc" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1dc661-26d9-462c-b922-3f9aa4726ce4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:03 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc Nov 06 21:54:03 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:04 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc" returned: 0 in 0.369s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:04 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc Nov 06 21:54:04 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:04 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6d282793-1054-49a3-8942-1687402aebcc" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-quobyte-6d282793-1054-49a3-8942-1687402aebcc" released by "delete_volume" :: held 0.665s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Created reservations ['ba24f857-3b1e-4a2c-83e2-84bd2a201106', '1a6f7e7c-1447-43cd-beca-2adf334b53df', '50eeef64-d1ba-4ee1-a826-9c2d01bbd8f0', 'b7fc658b-bdc3-406c-b820-c8ad699eb91c'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:04 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:04 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:04 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.254s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Deleted volume successfully. Nov 06 21:54:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ec8ad859-cfa1-4a1a-ad86-3e5e7206bc6e tempest-CreateVolumesFromImageTest-64847206 None] Lock "cinder-6d282793-1054-49a3-8942-1687402aebcc-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Flow 'volume_create_manager' (a76f4778-26d9-406f-9591-606a59f52a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ce5e7e-100b-4130-82ba-53ad3d501bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ce5e7e-100b-4130-82ba-53ad3d501bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-460706965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2ff5b3-4733-4ed6-8968-a9600aedf06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fadde633a1489c972aab3f7d05fadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:08Z,use_quota=True,user_id='5c74707a4c974352a36c008ca16fe6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c14515e-a969-4a1e-a1ad-36ccb6992e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c14515e-a969-4a1e-a1ad-36ccb6992e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14a8351-b34e-4ea1-8e1f-94fb05e56b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14a8351-b34e-4ea1-8e1f-94fb05e56b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed2ff5b3-4733-4ed6-8968-a9600aedf06e', 'volume_name': 'volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aa9a1d-6d4b-4661-acc5-50d66ed54ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aa9a1d-6d4b-4661-acc5-50d66ed54ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707f82ef-6437-4d97-a602-046447a96b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:07 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Volume ed2ff5b3-4733-4ed6-8968-a9600aedf06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e', 'volume_size': 1} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-460706965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2ff5b3-4733-4ed6-8968-a9600aedf06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fadde633a1489c972aab3f7d05fadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:08Z,use_quota=True,user_id='5c74707a4c974352a36c008ca16fe6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Creating volume ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:54:07 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:54:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:07 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e 1073741824 Nov 06 21:54:07 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:08 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e 1073741824" returned: 0 in 0.436s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:08 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e Nov 06 21:54:08 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:08 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" returned: 0 in 0.253s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707f82ef-6437-4d97-a602-046447a96b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85320ba1-6cc3-45fd-acd6-cc3ba721827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:08 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Volume volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e (ed2ff5b3-4733-4ed6-8968-a9600aedf06e): created successfully Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85320ba1-6cc3-45fd-acd6-cc3ba721827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Flow 'volume_create_manager' (a76f4778-26d9-406f-9591-606a59f52a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-828a133f-dda0-484e-ba87-6f7234dacfae tempest-VolumeDependencyTests-1054227545 None] Created volume successfully. Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Creating offline snapshot 87160bf6-974d-48b8-8a82-f6b81c0a12c0 of volume ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fe4951-599b-4340-8658-a4b59badedb1]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:09 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e Nov 06 21:54:09 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:09 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" returned: 0 in 0.388s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:09 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 1G Nov 06 21:54:09 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Acquiring lock "cinder-bdd23801-9bf9-43c6-9568-cf9e797476ab-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Lock "cinder-bdd23801-9bf9-43c6-9568-cf9e797476ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Acquiring lock "cinder-quobyte-bdd23801-9bf9-43c6-9568-cf9e797476ab" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Lock "cinder-quobyte-bdd23801-9bf9-43c6-9568-cf9e797476ab" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ce7a29-b1c2-4cf7-8084-70a4912dd22e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:09 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab Nov 06 21:54:09 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:09 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 1G" returned: 0 in 0.400s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:09 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 Nov 06 21:54:09 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:09 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:09 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab Nov 06 21:54:09 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:09 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:09 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 is being set with open permissions: ugo+rw Nov 06 21:54:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:10 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 Nov 06 21:54:10 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:10 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bdd23801-9bf9-43c6-9568-cf9e797476ab" returned: 0 in 0.256s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Lock "cinder-quobyte-bdd23801-9bf9-43c6-9568-cf9e797476ab" released by "delete_volume" :: held 0.674s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Created reservations ['8c0d3885-d08b-4473-b0e1-d5fc9768029f', 'ec9f872e-ae54-45cf-bf4a-cea0f76433d5', '7ba87197-bd75-45a0-b4b8-57967d887203', '022cd4b8-4c49-4928-930d-ae0090744cae'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:10 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:10 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:10 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0" returned: 0 in 0.255s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:10 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.info Nov 06 21:54:10 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:10 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.257s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:10 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Deleted volume successfully. Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c70abdf8-29da-40a7-8328-8d336cae21df tempest-VolumesNegativeTest-1866794614 None] Lock "cinder-bdd23801-9bf9-43c6-9568-cf9e797476ab-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:10 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.info" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:10 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.info is being set with open permissions: ugo+rw Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:10 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.info Nov 06 21:54:10 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:10 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.info" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:10 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1112cc1a-0b94-4a50-9181-86402260515e tempest-VolumeDependencyTests-1054227545 None] Create snapshot completed successfully Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Flow 'volume_create_manager' (131a973b-32a7-4ce5-a13b-681ca6cfaebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c596ab-3348-4022-8b5b-422b8a1f357e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c596ab-3348-4022-8b5b-422b8a1f357e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-188691824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5be3ff-3067-4691-b4cb-e4434fd58c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fadde633a1489c972aab3f7d05fadb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=87160bf6-974d-48b8-8a82-f6b81c0a12c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:11Z,use_quota=True,user_id='5c74707a4c974352a36c008ca16fe6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8b420c-c81a-4bd6-8ce2-dc145f151e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8b420c-c81a-4bd6-8ce2-dc145f151e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cc57b4-96af-473c-97ad-aa11f27170d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69cc57b4-96af-473c-97ad-aa11f27170d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c5be3ff-3067-4691-b4cb-e4434fd58c5a', 'volume_name': 'volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a', 'volume_size': 1, 'snapshot_id': '87160bf6-974d-48b8-8a82-f6b81c0a12c0'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af400010-bd45-4d32-bcee-03d12635814b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af400010-bd45-4d32-bcee-03d12635814b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca30eb0-a9b0-4741-9ef4-bcde26577670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:11 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Volume 6c5be3ff-3067-4691-b4cb-e4434fd58c5a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a', 'volume_size': 1, 'snapshot_id': '87160bf6-974d-48b8-8a82-f6b81c0a12c0'} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-quobyte-87160bf6-974d-48b8-8a82-f6b81c0a12c0-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-87160bf6-974d-48b8-8a82-f6b81c0a12c0-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Creating volume 6c5be3ff-3067-4691-b4cb-e4434fd58c5a from snapshot 87160bf6-974d-48b8-8a82-f6b81c0a12c0 {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-quobyte-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] snapshot: 87160bf6-974d-48b8-8a82-f6b81c0a12c0, volume: 6c5be3ff-3067-4691-b4cb-e4434fd58c5a, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f90051-f3ec-48da-b2e0-c3b53e381df8]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:11 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 Nov 06 21:54:11 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:12 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0" returned: 0 in 0.374s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc318e8-8336-43de-8af1-aa5ed3c98741]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:12 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e Nov 06 21:54:12 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:12 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" returned: 0 in 0.391s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:54:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:12 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a Nov 06 21:54:12 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Flow 'volume_create_manager' (6c4a25fb-9f69-40fd-9eea-b259a6d0e319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df85307-ea68-4b4b-9864-fc0f4abfcac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3df85307-ea68-4b4b-9864-fc0f4abfcac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-729422678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec6e434-bd00-43a7-b0fe-e015f44eb671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4db5da9f49496886b7fed7c0353a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:14Z,use_quota=True,user_id='7af9e36d0d29433fa39e91748f16a022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca211a5c-941e-4ac6-84ad-35ec02e10e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca211a5c-941e-4ac6-84ad-35ec02e10e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a58a462-037a-4a9a-a4d3-98def0fd98b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a58a462-037a-4a9a-a4d3-98def0fd98b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec6e434-bd00-43a7-b0fe-e015f44eb671', 'volume_name': 'volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671', 'volume_size': 2}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6231be1-d356-44f2-a9ba-902611f53545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6231be1-d356-44f2-a9ba-902611f53545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172aaaef-704a-430e-b66c-eb1a62336c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Volume 9ec6e434-bd00-43a7-b0fe-e015f44eb671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671', 'volume_size': 2} Nov 06 21:54:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:18 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" returned: 0 in 6.374s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:18 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:54:18 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Converted 1024.00 MB image at 160.62 MB/s Nov 06 21:54:18 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a is being set with open permissions: ugo+rw Nov 06 21:54:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:18 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a Nov 06 21:54:18 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:19 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" returned: 0 in 0.241s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" released by "_copy_volume_from_snapshot" :: held 7.472s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-87160bf6-974d-48b8-8a82-f6b81c0a12c0-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" released by "_create_volume_from_snapshot" :: held 7.539s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.558s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.453s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-729422678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec6e434-bd00-43a7-b0fe-e015f44eb671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4db5da9f49496886b7fed7c0353a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:14Z,use_quota=True,user_id='7af9e36d0d29433fa39e91748f16a022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Creating volume 9ec6e434-bd00-43a7-b0fe-e015f44eb671 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:54:19 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 2147483648 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:19 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 2147483648 Nov 06 21:54:19 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca30eb0-a9b0-4741-9ef4-bcde26577670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a', 'volume_size': 1, 'snapshot_id': '87160bf6-974d-48b8-8a82-f6b81c0a12c0'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b8e824-2fe8-41ca-bcbe-ba5bc41b6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Volume volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a (6c5be3ff-3067-4691-b4cb-e4434fd58c5a): created successfully Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b8e824-2fe8-41ca-bcbe-ba5bc41b6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Flow 'volume_create_manager' (131a973b-32a7-4ce5-a13b-681ca6cfaebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c87ee1b0-5023-4352-98c5-e080949b85eb tempest-VolumeDependencyTests-1054227545 None] Created volume successfully. Nov 06 21:54:19 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 2147483648" returned: 0 in 0.445s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:19 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 Nov 06 21:54:19 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:19 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172aaaef-704a-430e-b66c-eb1a62336c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671', 'volume_size': 2}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483663b0-2a76-4bed-b8ca-f78b22e67dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Volume volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 (9ec6e434-bd00-43a7-b0fe-e015f44eb671): created successfully Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483663b0-2a76-4bed-b8ca-f78b22e67dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Flow 'volume_create_manager' (6c4a25fb-9f69-40fd-9eea-b259a6d0e319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6ed23196-9cd0-4ba7-b509-ce304ed75bed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Created volume successfully. Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-87160bf6-974d-48b8-8a82-f6b81c0a12c0-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-87160bf6-974d-48b8-8a82-f6b81c0a12c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-quobyte-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-quobyte-87160bf6-974d-48b8-8a82-f6b81c0a12c0" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-87160bf6-974d-48b8-8a82-f6b81c0a12c0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Deleting offline snapshot 87160bf6-974d-48b8-8a82-f6b81c0a12c0 of volume ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] snapshot_file for this snap is: volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d0eab8-3b7f-4741-ae5c-d3db1df011f6]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:20 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 Nov 06 21:54:20 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:20 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0" returned: 0 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b2c3e1-04a3-4fb3-a949-41836bd6ef1e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:20 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e Nov 06 21:54:20 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Creating offline snapshot 0de2017f-4ce1-411f-abe6-63b084699ec7 of volume 9ec6e434-bd00-43a7-b0fe-e015f44eb671 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eccde9a-592a-4228-bbd0-0a4b686ad1e0]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:21 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" returned: 0 in 0.545s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:21 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 Nov 06 21:54:21 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:21 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 Nov 06 21:54:21 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:21 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671" returned: 0 in 0.366s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 2G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:21 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0" returned: 0 in 0.348s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:21 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 2G Nov 06 21:54:21 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:21 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0 Nov 06 21:54:21 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:21 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e.87160bf6-974d-48b8-8a82-f6b81c0a12c0" returned: 0 in 0.249s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-87160bf6-974d-48b8-8a82-f6b81c0a12c0" released by "_delete_snapshot" :: held 1.593s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" released by "delete_snapshot" :: held 1.614s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Created reservations ['bc10d670-0b4e-426f-96a6-b56e7c7597a3', 'cf259f18-098c-4f09-99bd-6ca6589419fa', 'b4280023-b96d-4ac6-bda3-d8a4a5444ea0', '867a5052-dbc0-4861-8692-f653e7ab0322'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:21 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 2G" returned: 0 in 0.422s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Delete snapshot completed successfully. Nov 06 21:54:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3ae1e2d0-ccd7-43c8-8083-dd0f6cc326e6 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-87160bf6-974d-48b8-8a82-f6b81c0a12c0-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:21 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 Nov 06 21:54:21 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:22 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:22 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 is being set with open permissions: ugo+rw Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:22 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 Nov 06 21:54:22 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-ed2ff5b3-4733-4ed6-8968-a9600aedf06e-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-ed2ff5b3-4733-4ed6-8968-a9600aedf06e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-quobyte-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[610b5e40-76f4-4014-908a-f297450ae74a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:22 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7" returned: 0 in 0.249s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:22 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.info Nov 06 21:54:22 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:22 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e Nov 06 21:54:22 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:22 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.info" returned: 0 in 0.248s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:22 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.info is being set with open permissions: ugo+rw Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:22 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.info Nov 06 21:54:22 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:22 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" returned: 0 in 0.371s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:22 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e Nov 06 21:54:22 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:23 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.info" returned: 0 in 0.248s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2026f5be-8196-4249-832a-2ef9aeeb1859 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Create snapshot completed successfully Nov 06 21:54:23 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-ed2ff5b3-4733-4ed6-8968-a9600aedf06e" released by "delete_volume" :: held 0.687s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Created reservations ['939c3ef9-9ab4-46e8-9914-0f03a131e502', '86a81b7a-2df7-4a5d-9e01-d4087b7f3e5d', '303c3a4b-77f3-405b-89a6-661172c38c9d', '68399a5c-8b6a-4bff-99df-bd140752c226'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:23 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:23 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "cinder-0de2017f-4ce1-411f-abe6-63b084699ec7-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-0de2017f-4ce1-411f-abe6-63b084699ec7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "cinder-quobyte-9ec6e434-bd00-43a7-b0fe-e015f44eb671" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-quobyte-9ec6e434-bd00-43a7-b0fe-e015f44eb671" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "cinder-quobyte-0de2017f-4ce1-411f-abe6-63b084699ec7" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-quobyte-0de2017f-4ce1-411f-abe6-63b084699ec7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Deleting offline snapshot 0de2017f-4ce1-411f-abe6-63b084699ec7 of volume 9ec6e434-bd00-43a7-b0fe-e015f44eb671 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] snapshot_file for this snap is: volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1a7a08-d6a3-4558-9b90-0c1fbf0a36f0]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:23 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.273s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Deleted volume successfully. Nov 06 21:54:23 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 Nov 06 21:54:23 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-6c5be3ff-3067-4691-b4cb-e4434fd58c5a-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-269961d4-113e-437c-a176-32a38644cff3 tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-ed2ff5b3-4733-4ed6-8968-a9600aedf06e-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-6c5be3ff-3067-4691-b4cb-e4434fd58c5a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "cinder-quobyte-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10dcd8a-8cf0-4a00-9418-7b99e3bd5085]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:23 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a Nov 06 21:54:23 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:23 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7" returned: 0 in 0.391s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[96abd000-1bc5-47b6-8e2a-47781ae93ecf]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:23 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 Nov 06 21:54:23 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:24 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" returned: 0 in 0.373s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:24 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a Nov 06 21:54:24 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:24 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671" returned: 0 in 0.359s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:24 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 Nov 06 21:54:24 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:24 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-quobyte-6c5be3ff-3067-4691-b4cb-e4434fd58c5a" released by "delete_volume" :: held 0.691s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Created reservations ['969f12a0-e6a8-4171-af08-7c1cf7f0c726', '81cda88f-bdef-4a12-855b-f6877c47c8fc', '2ec4cf68-bb6d-4d70-a1cf-c53b6f7d83c6', '23ab7020-d489-4cb1-bc54-80277639433a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:24 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:24 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:24 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:24 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7 Nov 06 21:54:24 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:24 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.270s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Deleted volume successfully. Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2f08597d-22a8-47de-ad5c-d65a05e66d0b tempest-VolumeDependencyTests-1054227545 None] Lock "cinder-6c5be3ff-3067-4691-b4cb-e4434fd58c5a-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:24 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671.0de2017f-4ce1-411f-abe6-63b084699ec7" returned: 0 in 0.266s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-quobyte-0de2017f-4ce1-411f-abe6-63b084699ec7" released by "_delete_snapshot" :: held 1.497s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-quobyte-9ec6e434-bd00-43a7-b0fe-e015f44eb671" released by "delete_snapshot" :: held 1.525s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Created reservations ['a5aed26f-5556-4d7e-bc36-82bdefdab2d0', '8401eae4-68f8-4ba9-82f2-097a535608d6', '2a0fe06a-9fc4-4d9b-abe0-ff4ff24e7145', '9aa71880-0a74-4f21-b856-7c5b135ddcbe'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Delete snapshot completed successfully. Nov 06 21:54:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c61bc486-b955-4762-9002-7b039330a1ed tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-0de2017f-4ce1-411f-abe6-63b084699ec7-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "cinder-9ec6e434-bd00-43a7-b0fe-e015f44eb671-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-9ec6e434-bd00-43a7-b0fe-e015f44eb671-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "cinder-quobyte-9ec6e434-bd00-43a7-b0fe-e015f44eb671" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-quobyte-9ec6e434-bd00-43a7-b0fe-e015f44eb671" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94263fe-4862-4db3-9df0-f41db58fb4bd]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:25 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 Nov 06 21:54:25 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:26 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671" returned: 0 in 0.378s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:26 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671 Nov 06 21:54:26 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:26 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9ec6e434-bd00-43a7-b0fe-e015f44eb671" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-quobyte-9ec6e434-bd00-43a7-b0fe-e015f44eb671" released by "delete_volume" :: held 0.708s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Created reservations ['b6f3bb6b-7803-41dd-986e-3154aebe052c', 'de509b81-fd7b-40d2-a496-ee31bf99f66c', '9f5d33dd-481b-434b-8d92-764c030fe9d8', '166f17b2-d4cc-4bab-be0a-690493fe4df7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:26 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:26 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:26 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.266s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Deleted volume successfully. Nov 06 21:54:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f33a7c73-bcdf-49ca-97b2-b5bb59702b21 tempest-VolumesSnapshotNegativeTestJSON-1341350752 None] Lock "cinder-9ec6e434-bd00-43a7-b0fe-e015f44eb671-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Flow 'volume_create_manager' (e46d97d9-d463-41df-888d-ef21947dda61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a07f456-bf0b-4d15-b26e-77f9b672bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a07f456-bf0b-4d15-b26e-77f9b672bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0334a662-c769-4c82-81c2-5050e8997ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f310943d286d461b8fd0c7502c7563ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:30Z,use_quota=True,user_id='cf70ba65e5b2456685595a790b833540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2279e20-ff8b-47cf-bd82-dd9218683a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2279e20-ff8b-47cf-bd82-dd9218683a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9355e8d4-6aac-47f9-92e4-5c0802df4e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9355e8d4-6aac-47f9-92e4-5c0802df4e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0334a662-c769-4c82-81c2-5050e8997ca6', 'volume_name': 'volume-0334a662-c769-4c82-81c2-5050e8997ca6', 'volume_size': 1, 'image_id': '0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c729aa884c4e09b9c6901010097fad4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f310943d286d461b8fd0c7502c7563ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cc1668ca8c1d48c9aba24608054ea0b6ad24b1517ebbb42dc8278237d52e3508c542bf254d41d27804515d7d1752ea8e52015e366c44440d2c2a42c41c457ec', 'id': '0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'created_at': datetime.datetime(2026, 11, 6, 20, 54, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 54, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23/file', 'properties': {}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d91ff5c-6302-4350-9d69-bc364ac078b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d91ff5c-6302-4350-9d69-bc364ac078b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc4b352-386a-4825-ae1b-b6a3073d928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:30 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Volume 0334a662-c769-4c82-81c2-5050e8997ca6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0334a662-c769-4c82-81c2-5050e8997ca6', 'volume_size': 1, 'image_id': '0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c729aa884c4e09b9c6901010097fad4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f310943d286d461b8fd0c7502c7563ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cc1668ca8c1d48c9aba24608054ea0b6ad24b1517ebbb42dc8278237d52e3508c542bf254d41d27804515d7d1752ea8e52015e366c44440d2c2a42c41c457ec', 'id': '0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'created_at': datetime.datetime(2026, 11, 6, 20, 54, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 54, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23/file', 'properties': {}}, 'image_service': } Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Trying to clone 0334a662-c769-4c82-81c2-5050e8997ca6 from image 0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:54:30 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae3d49b-39a4-4d9b-b71d-ee98eb84cd94]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:31 devstack sudo[104527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD Nov 06 21:54:31 devstack sudo[104527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:31 devstack sudo[104527]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:31 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD Nov 06 21:54:31 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:31 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:54:31 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Temporary image 0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23 is fetched for user cf70ba65e5b2456685595a790b833540. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:54:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[142e6c75-8926-4096-a837-941d5d377db1]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:31 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD Nov 06 21:54:31 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:32 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:32 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD Nov 06 21:54:32 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:32 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0334a662-c769-4c82-81c2-5050e8997ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f310943d286d461b8fd0c7502c7563ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:30Z,use_quota=True,user_id='cf70ba65e5b2456685595a790b833540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Creating volume 0334a662-c769-4c82-81c2-5050e8997ca6 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:54:32 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:32 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 1073741824 Nov 06 21:54:32 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:32 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 1073741824" returned: 0 in 0.420s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:32 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 Nov 06 21:54:32 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:33 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Attempting download of 0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'metadata': {}}])) to volume 0334a662-c769-4c82-81c2-5050e8997ca6. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[774b4977-2549-4082-886d-4c4c9addb949]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23___wmkohe {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:33 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23___wmkohe Nov 06 21:54:33 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:33 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23___wmkohe" returned: 0 in 0.443s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23___wmkohe {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:33 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23___wmkohe Nov 06 21:54:33 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:33 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23___wmkohe" returned: 1 in 0.352s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23___wmkohe' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b47c58-662d-42e2-9241-7355a8513b53]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:34 devstack sudo[104561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD Nov 06 21:54:34 devstack sudo[104561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:34 devstack sudo[104561]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:34 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD Nov 06 21:54:34 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:34 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:54:34 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] 0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23 was raw, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:54:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:34 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 Nov 06 21:54:34 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:35 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6" returned: 0 in 0.480s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23_q_8g6dcjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:54:35 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:35 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 1G Nov 06 21:54:35 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:35 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 1G" returned: 0 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Downloaded image 0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23 ((None, [{'url': 'file:///opt/stack/data/glance/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'metadata': {}}])) to volume 0334a662-c769-4c82-81c2-5050e8997ca6 successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Temporary image 0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23 for user cf70ba65e5b2456685595a790b833540 is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Marking volume 0334a662-c769-4c82-81c2-5050e8997ca6 as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Copying metadata from image 0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23 to 0334a662-c769-4c82-81c2-5050e8997ca6. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Creating volume glance metadata for volume 0334a662-c769-4c82-81c2-5050e8997ca6 backed by image 0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23 with: {'image_id': '0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6c729aa884c4e09b9c6901010097fad4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc4b352-386a-4825-ae1b-b6a3073d928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0334a662-c769-4c82-81c2-5050e8997ca6', 'volume_size': 1, 'image_id': '0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c729aa884c4e09b9c6901010097fad4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f310943d286d461b8fd0c7502c7563ea', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1cc1668ca8c1d48c9aba24608054ea0b6ad24b1517ebbb42dc8278237d52e3508c542bf254d41d27804515d7d1752ea8e52015e366c44440d2c2a42c41c457ec', 'id': '0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23', 'created_at': datetime.datetime(2026, 11, 6, 20, 54, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 54, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0d24fe2d-7a18-41dc-a9c1-2521bb3c8c23/file', 'properties': {}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af381ecc-3d2e-4bc6-92dc-d8cd2075ae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:35 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Volume volume-0334a662-c769-4c82-81c2-5050e8997ca6 (0334a662-c769-4c82-81c2-5050e8997ca6): created successfully Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af381ecc-3d2e-4bc6-92dc-d8cd2075ae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:35 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Flow 'volume_create_manager' (e46d97d9-d463-41df-888d-ef21947dda61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:35 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9a1e882a-9afc-4297-8be3-feb655f1a46f tempest-VolumeImageDependencyTests-1931641310 None] Created volume successfully. Nov 06 21:54:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Acquiring lock "cinder-0334a662-c769-4c82-81c2-5050e8997ca6-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Lock "cinder-0334a662-c769-4c82-81c2-5050e8997ca6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Acquiring lock "cinder-quobyte-0334a662-c769-4c82-81c2-5050e8997ca6" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:54:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Lock "cinder-quobyte-0334a662-c769-4c82-81c2-5050e8997ca6" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:54:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c3e89-a70e-4f41-b6f9-50781fc17f22]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:36 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 Nov 06 21:54:36 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:37 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:37 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6 Nov 06 21:54:37 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:37 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0334a662-c769-4c82-81c2-5050e8997ca6" returned: 0 in 0.248s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Lock "cinder-quobyte-0334a662-c769-4c82-81c2-5050e8997ca6" released by "delete_volume" :: held 0.678s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Created reservations ['1d0a1daf-6d8a-4cd5-9255-72c6eb421009', 'bb925af8-0dc2-4dba-b224-96564a5a6c21', 'fade1d31-599a-4b5e-a4cb-994d6ef22b0b', '92bf1c56-d149-4859-9e13-6c3a13e2f583'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:37 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:37 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:37 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.341s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Deleted volume successfully. Nov 06 21:54:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4e14a93b-b209-4066-a64b-a0c1a798a624 tempest-VolumeImageDependencyTests-1931641310 None] Lock "cinder-0334a662-c769-4c82-81c2-5050e8997ca6-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:54:47 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=68,cinder:UPDATE=100,cinder:INSERT=29,cinder:DELETE=7 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:54:47 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=79,cinder:DELETE=8,cinder:INSERT=26,cinder:UPDATE=91 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Flow 'volume_create_manager' (5acf141c-0eac-4120-98dc-f740bc3210c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25642fc3-bdb8-48e1-ad28-d84ae601ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25642fc3-bdb8-48e1-ad28-d84ae601ed18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-669148371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ce3b3c-1707-4fef-96bf-1a02482e1fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f26b00ac94afbbf7f53b6a722da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:51Z,use_quota=True,user_id='76b01c6e8a634994af7038c57f548d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(565c8de6-ce00-453d-901d-29e885b3a222),volume_type_id=565c8de6-ce00-453d-901d-29e885b3a222)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b7f1cd-000f-4ca1-9a67-292b41636e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83b7f1cd-000f-4ca1-9a67-292b41636e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc532af-7ebf-43fa-8898-bc2f21b67d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc532af-7ebf-43fa-8898-bc2f21b67d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ce3b3c-1707-4fef-96bf-1a02482e1fda', 'volume_name': 'volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c39c5a5-1759-4d0f-a9d9-2b085ed871f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c39c5a5-1759-4d0f-a9d9-2b085ed871f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296fc256-054e-4339-ac22-c5c7b96f5d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:51 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume 86ce3b3c-1707-4fef-96bf-1a02482e1fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda', 'volume_size': 1} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-669148371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ce3b3c-1707-4fef-96bf-1a02482e1fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f26b00ac94afbbf7f53b6a722da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:51Z,use_quota=True,user_id='76b01c6e8a634994af7038c57f548d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(565c8de6-ce00-453d-901d-29e885b3a222),volume_type_id=565c8de6-ce00-453d-901d-29e885b3a222)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Creating volume 86ce3b3c-1707-4fef-96bf-1a02482e1fda {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:54:51 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:54:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:51 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda 1073741824 Nov 06 21:54:51 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Flow 'volume_create_manager' (6b67e89b-6e2f-493d-865c-2f8f321865eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21ccb72-30be-4da1-be80-acda83a053bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21ccb72-30be-4da1-be80-acda83a053bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-683850294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5fb348-4e5f-4edd-b056-ace2a93e7f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f26b00ac94afbbf7f53b6a722da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:52Z,use_quota=True,user_id='76b01c6e8a634994af7038c57f548d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5bfed6-de8d-495d-a3c7-b43e9fdc2dbd),volume_type_id=4b5bfed6-de8d-495d-a3c7-b43e9fdc2dbd)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1287ac-17a8-4b26-abdf-48b844302bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1287ac-17a8-4b26-abdf-48b844302bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4988e416-8358-45bc-94e2-d869fddb276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4988e416-8358-45bc-94e2-d869fddb276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5fb348-4e5f-4edd-b056-ace2a93e7f9f', 'volume_name': 'volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91411a38-0af4-4a2b-8b0a-34d38a815b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91411a38-0af4-4a2b-8b0a-34d38a815b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92a62d0-33d0-458f-b08e-a96faf74b15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:52 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume 7a5fb348-4e5f-4edd-b056-ace2a93e7f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f', 'volume_size': 1} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:52 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda 1073741824" returned: 0 in 0.626s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:52 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda Nov 06 21:54:52 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:52 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda" returned: 0 in 0.410s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-683850294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5fb348-4e5f-4edd-b056-ace2a93e7f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f26b00ac94afbbf7f53b6a722da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:52Z,use_quota=True,user_id='76b01c6e8a634994af7038c57f548d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b5bfed6-de8d-495d-a3c7-b43e9fdc2dbd),volume_type_id=4b5bfed6-de8d-495d-a3c7-b43e9fdc2dbd)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Creating volume 7a5fb348-4e5f-4edd-b056-ace2a93e7f9f {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:54:52 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:52 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f 1073741824 Nov 06 21:54:52 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296fc256-054e-4339-ac22-c5c7b96f5d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5f85ab-2860-4643-b6f7-87d753192d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:52 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda (86ce3b3c-1707-4fef-96bf-1a02482e1fda): created successfully Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d5f85ab-2860-4643-b6f7-87d753192d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Flow 'volume_create_manager' (5acf141c-0eac-4120-98dc-f740bc3210c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-52e3bf79-36fb-477a-9090-1d2fb42b0eb2 tempest-TestInstancesWithCinderVolumes-2130655530 None] Created volume successfully. Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Flow 'volume_create_manager' (607ab41c-7ff3-46ed-9d79-3398ccfef045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4be965-279e-4087-aa35-84418393531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4be965-279e-4087-aa35-84418393531a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1461701045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7996b673-b933-48d0-b910-cb98d2ecc237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f26b00ac94afbbf7f53b6a722da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:53Z,use_quota=True,user_id='76b01c6e8a634994af7038c57f548d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d58edaf-2ff5-4980-b5fb-151b1132b473),volume_type_id=5d58edaf-2ff5-4980-b5fb-151b1132b473)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e293ff7a-9fba-4b6c-a83f-2f1881ba42e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e293ff7a-9fba-4b6c-a83f-2f1881ba42e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973bcfff-06ee-4167-8474-1acd101b7483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:54:53 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f 1073741824" returned: 0 in 0.555s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:53 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f Nov 06 21:54:53 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973bcfff-06ee-4167-8474-1acd101b7483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7996b673-b933-48d0-b910-cb98d2ecc237', 'volume_name': 'volume-7996b673-b933-48d0-b910-cb98d2ecc237', 'volume_size': 1, 'image_id': '07910896-4f4a-4f89-97f2-48ded0347e95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07910896-4f4a-4f89-97f2-48ded0347e95', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--29325653', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e42f26b00ac94afbbf7f53b6a722da0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07910896-4f4a-4f89-97f2-48ded0347e95', 'created_at': datetime.datetime(2026, 11, 6, 20, 54, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 54, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07910896-4f4a-4f89-97f2-48ded0347e95/file', 'properties': {}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03127524-e7d3-47c3-a92c-b549ba202024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03127524-e7d3-47c3-a92c-b549ba202024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20abd24-9efa-42be-a31c-22ba7c25e11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume 7996b673-b933-48d0-b910-cb98d2ecc237: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7996b673-b933-48d0-b910-cb98d2ecc237', 'volume_size': 1, 'image_id': '07910896-4f4a-4f89-97f2-48ded0347e95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07910896-4f4a-4f89-97f2-48ded0347e95', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--29325653', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e42f26b00ac94afbbf7f53b6a722da0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07910896-4f4a-4f89-97f2-48ded0347e95', 'created_at': datetime.datetime(2026, 11, 6, 20, 54, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 54, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07910896-4f4a-4f89-97f2-48ded0347e95/file', 'properties': {}}, 'image_service': } Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Trying to clone 7996b673-b933-48d0-b910-cb98d2ecc237 from image 07910896-4f4a-4f89-97f2-48ded0347e95 at location (None, [{'url': 'file:///opt/stack/data/glance/images/07910896-4f4a-4f89-97f2-48ded0347e95', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:54:53 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f" returned: 0 in 0.283s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92a62d0-33d0-458f-b08e-a96faf74b15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dd2a16-0733-43c0-bd1c-809463833c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:54:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f (7a5fb348-4e5f-4edd-b056-ace2a93e7f9f): created successfully Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dd2a16-0733-43c0-bd1c-809463833c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:54:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Flow 'volume_create_manager' (6b67e89b-6e2f-493d-865c-2f8f321865eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:54:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2056ae16-6098-4d54-ac38-386aa3e0e726 tempest-TestInstancesWithCinderVolumes-2130655530 None] Created volume successfully. Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD, size 20.69 MB, duration 3.68 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:54:57 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Image download 20.69 MB at 5.63 MB/s Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[203c8829-66b7-4486-8246-6277712e3cd3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:57 devstack sudo[104656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD Nov 06 21:54:57 devstack sudo[104656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:57 devstack sudo[104656]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Temporary image 07910896-4f4a-4f89-97f2-48ded0347e95 is fetched for user 76b01c6e8a634994af7038c57f548d0c. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f1d684-cfcd-44f5-93e2-dcbdef704086]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:57 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD Nov 06 21:54:57 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:57 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1461701045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7996b673-b933-48d0-b910-cb98d2ecc237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e42f26b00ac94afbbf7f53b6a722da0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:54:53Z,use_quota=True,user_id='76b01c6e8a634994af7038c57f548d0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d58edaf-2ff5-4980-b5fb-151b1132b473),volume_type_id=5d58edaf-2ff5-4980-b5fb-151b1132b473)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Creating volume 7996b673-b933-48d0-b910-cb98d2ecc237 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:54:57 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:54:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:57 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 1073741824 Nov 06 21:54:57 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:58 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 1073741824" returned: 0 in 0.493s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:58 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 Nov 06 21:54:58 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:58 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237" returned: 0 in 0.247s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Attempting download of 07910896-4f4a-4f89-97f2-48ded0347e95 ((None, [{'url': 'file:///opt/stack/data/glance/images/07910896-4f4a-4f89-97f2-48ded0347e95', 'metadata': {}}])) to volume 7996b673-b933-48d0-b910-cb98d2ecc237. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:54:58 devstack sudo[104675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:54:58 devstack sudo[104675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cc966a-b5f0-4c60-a4be-3a907a6f2643]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07910896-4f4a-4f89-97f2-48ded0347e95_beuo70j3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:58 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07910896-4f4a-4f89-97f2-48ded0347e95_beuo70j3 Nov 06 21:54:58 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:59 devstack sudo[104675]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.308s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:54:59 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_07910896-4f4a-4f89-97f2-48ded0347e95_beuo70j3" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07910896-4f4a-4f89-97f2-48ded0347e95_beuo70j3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:59 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07910896-4f4a-4f89-97f2-48ded0347e95_beuo70j3 Nov 06 21:54:59 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:59 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07910896-4f4a-4f89-97f2-48ded0347e95_beuo70j3" returned: 1 in 0.333s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_07910896-4f4a-4f89-97f2-48ded0347e95_beuo70j3' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e782032-93f9-4043-af8d-9dde693da39f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:59 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD Nov 06 21:54:59 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:54:59 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] 07910896-4f4a-4f89-97f2-48ded0347e95 was qcow2, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:54:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:54:59 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 Nov 06 21:54:59 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:02 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237" returned: 0 in 2.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_07910896-4f4a-4f89-97f2-48ded0347e95_6bsyn1hodevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:55:02 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Converted 112.00 MB image at 49.75 MB/s Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:02 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 1G Nov 06 21:55:02 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:02 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 1G" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Downloaded image 07910896-4f4a-4f89-97f2-48ded0347e95 ((None, [{'url': 'file:///opt/stack/data/glance/images/07910896-4f4a-4f89-97f2-48ded0347e95', 'metadata': {}}])) to volume 7996b673-b933-48d0-b910-cb98d2ecc237 successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Temporary image 07910896-4f4a-4f89-97f2-48ded0347e95 for user 76b01c6e8a634994af7038c57f548d0c is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Marking volume 7996b673-b933-48d0-b910-cb98d2ecc237 as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Copying metadata from image 07910896-4f4a-4f89-97f2-48ded0347e95 to 7996b673-b933-48d0-b910-cb98d2ecc237. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Creating volume glance metadata for volume 7996b673-b933-48d0-b910-cb98d2ecc237 backed by image 07910896-4f4a-4f89-97f2-48ded0347e95 with: {'image_id': '07910896-4f4a-4f89-97f2-48ded0347e95', 'image_name': 'tempest-scenario-img--29325653', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20abd24-9efa-42be-a31c-22ba7c25e11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7996b673-b933-48d0-b910-cb98d2ecc237', 'volume_size': 1, 'image_id': '07910896-4f4a-4f89-97f2-48ded0347e95', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/07910896-4f4a-4f89-97f2-48ded0347e95', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--29325653', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e42f26b00ac94afbbf7f53b6a722da0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '07910896-4f4a-4f89-97f2-48ded0347e95', 'created_at': datetime.datetime(2026, 11, 6, 20, 54, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 54, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/07910896-4f4a-4f89-97f2-48ded0347e95/file', 'properties': {}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeca3024-7bfe-468c-ba95-6cf7c731c6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:02 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Volume volume-7996b673-b933-48d0-b910-cb98d2ecc237 (7996b673-b933-48d0-b910-cb98d2ecc237): created successfully Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeca3024-7bfe-468c-ba95-6cf7c731c6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:02 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Flow 'volume_create_manager' (607ab41c-7ff3-46ed-9d79-3398ccfef045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:55:02 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fc03edd4-7c50-45da-8879-5c258e3a9b5e tempest-TestInstancesWithCinderVolumes-2130655530 None] Created volume successfully. Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Flow 'volume_create_manager' (3f738fd8-e4ed-482a-8c79-26a0b3d2ade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a77e42-0d86-411d-8267-55c75888a452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-9b5c550c-808e-47a2-84f1-a996ffa20d0a req-2e816007-a615-4261-a153-59e3ea16dab7 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-9b5c550c-808e-47a2-84f1-a996ffa20d0a req-2e816007-a615-4261-a153-59e3ea16dab7 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41a77e42-0d86-411d-8267-55c75888a452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1622708121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5197131c-e614-4e53-95b4-ae89c83e4d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df72d3a87d904b68b325366a3d006bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:55:06Z,use_quota=True,user_id='c0d833292866456abdca29bd16456152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a4e15c-8f1a-4bc6-a099-b49bdc41a91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a4e15c-8f1a-4bc6-a099-b49bdc41a91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16304436-5dfc-4041-b3ab-cdd319f72091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16304436-5dfc-4041-b3ab-cdd319f72091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5197131c-e614-4e53-95b4-ae89c83e4d75', 'volume_name': 'volume-5197131c-e614-4e53-95b4-ae89c83e4d75', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05d568b-411f-45d8-8d34-a670cb435e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b05d568b-411f-45d8-8d34-a670cb435e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042af968-345d-4e84-83ee-30cdb3345612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:06 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Volume 5197131c-e614-4e53-95b4-ae89c83e4d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5197131c-e614-4e53-95b4-ae89c83e4d75', 'volume_size': 1} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-9b5c550c-808e-47a2-84f1-a996ffa20d0a req-2e816007-a615-4261-a153-59e3ea16dab7 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1622708121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5197131c-e614-4e53-95b4-ae89c83e4d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df72d3a87d904b68b325366a3d006bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:55:06Z,use_quota=True,user_id='c0d833292866456abdca29bd16456152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Creating volume 5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:55:06 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:06 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 1073741824 Nov 06 21:55:06 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-9b5c550c-808e-47a2-84f1-a996ffa20d0a req-2e816007-a615-4261-a153-59e3ea16dab7 tempest-TestInstancesWithCinderVolumes-2130655530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-7996b673-b933-48d0-b910-cb98d2ecc237', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e669053e-58d0-4b0e-8c26-68953e1932e0', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:55:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-9b5c550c-808e-47a2-84f1-a996ffa20d0a req-2e816007-a615-4261-a153-59e3ea16dab7 tempest-TestInstancesWithCinderVolumes-2130655530 None] attachment_update completed successfully. Nov 06 21:55:07 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 1073741824" returned: 0 in 0.663s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:07 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 Nov 06 21:55:07 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:07 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75" returned: 0 in 0.293s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042af968-345d-4e84-83ee-30cdb3345612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5197131c-e614-4e53-95b4-ae89c83e4d75', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07d267a-6ba9-45dd-815f-b7cdf401a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:07 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Volume volume-5197131c-e614-4e53-95b4-ae89c83e4d75 (5197131c-e614-4e53-95b4-ae89c83e4d75): created successfully Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07d267a-6ba9-45dd-815f-b7cdf401a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Flow 'volume_create_manager' (3f738fd8-e4ed-482a-8c79-26a0b3d2ade3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:55:07 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e8b786dc-9003-487d-93d5-06375b29dc70 tempest-SnapshotDependencyTests-1337649054 None] Created volume successfully. Nov 06 21:55:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Creating offline snapshot 6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 of volume 5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:55:08 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6493cbd8-cd3c-4c7c-affd-0e59bb6507e4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:09 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 Nov 06 21:55:09 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:09 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75" returned: 0 in 0.554s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:09 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 1G Nov 06 21:55:09 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:10 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 1G" returned: 0 in 0.521s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5197131c-e614-4e53-95b4-ae89c83e4d75 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:10 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5197131c-e614-4e53-95b4-ae89c83e4d75 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 Nov 06 21:55:10 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:10 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5197131c-e614-4e53-95b4-ae89c83e4d75 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" returned: 0 in 0.292s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:10 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 is being set with open permissions: ugo+rw Nov 06 21:55:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:10 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 Nov 06 21:55:10 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:10 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:10 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.info Nov 06 21:55:10 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:10 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.info" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:10 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.info is being set with open permissions: ugo+rw Nov 06 21:55:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:10 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.info Nov 06 21:55:10 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:11 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.info" returned: 0 in 0.334s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.379s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0811fb3a-606c-48a1-bedb-dd8381499c16 tempest-SnapshotDependencyTests-1337649054 None] Create snapshot completed successfully Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Flow 'volume_create_manager' (bc79952d-d34c-47db-ae3f-73b2f0c75bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dbe33f-0df4-4300-a100-3f7f69b70db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2dbe33f-0df4-4300-a100-3f7f69b70db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f393bbf4-79bb-4c50-905b-37fac52417e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df72d3a87d904b68b325366a3d006bf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:55:13Z,use_quota=True,user_id='c0d833292866456abdca29bd16456152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5cd0cd-d7d2-4345-9454-570715b1a569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed5cd0cd-d7d2-4345-9454-570715b1a569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dffb32-5a8f-41d6-ac3c-8946ba330d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56dffb32-5a8f-41d6-ac3c-8946ba330d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f393bbf4-79bb-4c50-905b-37fac52417e0', 'volume_name': 'volume-f393bbf4-79bb-4c50-905b-37fac52417e0', 'volume_size': 1, 'snapshot_id': '6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c079fd8c-80b7-430e-a303-3e512424c34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c079fd8c-80b7-430e-a303-3e512424c34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ae79ef-2e89-4689-959d-c5d11081c038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:12 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Volume f393bbf4-79bb-4c50-905b-37fac52417e0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f393bbf4-79bb-4c50-905b-37fac52417e0', 'volume_size': 1, 'snapshot_id': '6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9'} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-quobyte-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9-f393bbf4-79bb-4c50-905b-37fac52417e0" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9-f393bbf4-79bb-4c50-905b-37fac52417e0" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Creating volume f393bbf4-79bb-4c50-905b-37fac52417e0 from snapshot 6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:55:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-quobyte-f393bbf4-79bb-4c50-905b-37fac52417e0" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-f393bbf4-79bb-4c50-905b-37fac52417e0" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] snapshot: 6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9, volume: f393bbf4-79bb-4c50-905b-37fac52417e0, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacb4bd5-c1f5-4f82-b5ec-61f38112eed3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:13 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 Nov 06 21:55:13 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:13 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" returned: 0 in 0.521s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5197131c-e614-4e53-95b4-ae89c83e4d75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2af0a-8121-4955-8672-988c98795745]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:13 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 Nov 06 21:55:13 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:14 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75" returned: 0 in 0.612s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:55:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:55:14 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:55:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:14 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 Nov 06 21:55:14 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:23 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0" returned: 0 in 8.752s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75, size 1024.00 MB, duration 8.75 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:55:23 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Converted 1024.00 MB image at 116.98 MB/s Nov 06 21:55:23 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 is being set with open permissions: ugo+rw Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:23 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 Nov 06 21:55:23 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:23 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-f393bbf4-79bb-4c50-905b-37fac52417e0" released by "_copy_volume_from_snapshot" :: held 10.254s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9-f393bbf4-79bb-4c50-905b-37fac52417e0" released by "_create_volume_from_snapshot" :: held 10.347s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.381s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ae79ef-2e89-4689-959d-c5d11081c038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f393bbf4-79bb-4c50-905b-37fac52417e0', 'volume_size': 1, 'snapshot_id': '6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c24e0e6-0b96-4cb4-8eab-f0d1f2168f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:55:23 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Volume volume-f393bbf4-79bb-4c50-905b-37fac52417e0 (f393bbf4-79bb-4c50-905b-37fac52417e0): created successfully Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c24e0e6-0b96-4cb4-8eab-f0d1f2168f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:55:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Flow 'volume_create_manager' (bc79952d-d34c-47db-ae3f-73b2f0c75bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:55:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-29aa32bc-6277-4a13-afb8-b2923d563a71 tempest-SnapshotDependencyTests-1337649054 None] Created volume successfully. Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-quobyte-5197131c-e614-4e53-95b4-ae89c83e4d75" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-5197131c-e614-4e53-95b4-ae89c83e4d75" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-quobyte-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Deleting offline snapshot 6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 of volume 5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] snapshot_file for this snap is: volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5677fb-d48b-43d0-a404-9c5c6e36e8fe]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:24 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 Nov 06 21:55:24 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:24 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" returned: 0 in 0.369s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5197131c-e614-4e53-95b4-ae89c83e4d75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[94137e62-7415-4f28-9374-268ebeea4356]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:24 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 Nov 06 21:55:24 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:25 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75" returned: 0 in 0.565s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:25 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 Nov 06 21:55:25 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:25 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" returned: 0 in 0.355s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:25 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9 Nov 06 21:55:25 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:25 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75.6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" returned: 0 in 0.273s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9" released by "_delete_snapshot" :: held 1.699s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-5197131c-e614-4e53-95b4-ae89c83e4d75" released by "delete_snapshot" :: held 1.726s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Created reservations ['794ba472-4a6d-4e96-ba41-78429640e6e2', '3595d7a1-018e-44f0-bf91-9317e4de4c2d', 'd3c07072-ccc0-4d3d-b732-81f0b4a8aeb9', '7078f20d-7537-495b-a9f1-d5dd86b5f0aa'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:55:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Delete snapshot completed successfully. Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7f30de1c-7a09-4de7-aaa3-e9642211c82f tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-6ae8de1a-d8ff-42d4-8d2e-2fbffba9e4d9-delete_snapshot" released by "delete_snapshot" :: held 1.886s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-5197131c-e614-4e53-95b4-ae89c83e4d75-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-5197131c-e614-4e53-95b4-ae89c83e4d75-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-quobyte-5197131c-e614-4e53-95b4-ae89c83e4d75" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-5197131c-e614-4e53-95b4-ae89c83e4d75" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1873fe89-c9e1-4007-bedc-be575dc29849]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:26 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 Nov 06 21:55:26 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:26 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75" returned: 0 in 0.384s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:26 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75 Nov 06 21:55:26 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:27 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5197131c-e614-4e53-95b4-ae89c83e4d75" returned: 0 in 0.243s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-5197131c-e614-4e53-95b4-ae89c83e4d75" released by "delete_volume" :: held 0.717s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Created reservations ['f9754cef-a13a-47f8-abb5-3baace0e1825', 'b9acfbe1-84ed-4fe6-9267-62c5c9d67ad0', '97d02be2-83c7-4388-9c7b-945f3ba1146d', 'e6a261f9-fc96-4e7a-9695-d7e0a8cef94d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:27 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:55:27 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:27 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.247s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:55:27 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Deleted volume successfully. Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b934dca3-5c2d-425d-9eb1-c39510266692 tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-5197131c-e614-4e53-95b4-ae89c83e4d75-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-f393bbf4-79bb-4c50-905b-37fac52417e0-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-f393bbf4-79bb-4c50-905b-37fac52417e0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "cinder-quobyte-f393bbf4-79bb-4c50-905b-37fac52417e0" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-f393bbf4-79bb-4c50-905b-37fac52417e0" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a018e7-45b3-46a0-81fb-c9bcb9a95894]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:27 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 Nov 06 21:55:27 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:27 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0" returned: 0 in 0.360s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:27 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0 Nov 06 21:55:27 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:28 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f393bbf4-79bb-4c50-905b-37fac52417e0" returned: 0 in 0.247s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-quobyte-f393bbf4-79bb-4c50-905b-37fac52417e0" released by "delete_volume" :: held 0.664s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Created reservations ['4ed8c905-324e-484c-9c00-5a9bda9db404', '9453a566-8e82-4c56-a235-fc73140b498e', '0cb7f648-bcd1-448a-ad54-89d5e50175dc', '5c1d2973-f8c3-438b-892c-12e9c3fac7f7'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:28 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:55:28 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:28 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.251s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:55:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Deleted volume successfully. Nov 06 21:55:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2e7a8c0e-ae9c-41b0-b227-982256fd0bac tempest-SnapshotDependencyTests-1337649054 None] Lock "cinder-f393bbf4-79bb-4c50-905b-37fac52417e0-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:38 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=45,cinder:UPDATE=40,cinder:DELETE=6,cinder:INSERT=14 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:55:38 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=43,cinder:SELECT=41,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:55:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-2499f847-b9e1-4cb7-a51f-ac82de390540 req-ba756148-5e28-42e2-9a8a-2b5f4020986f tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-2499f847-b9e1-4cb7-a51f-ac82de390540 req-ba756148-5e28-42e2-9a8a-2b5f4020986f tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-2499f847-b9e1-4cb7-a51f-ac82de390540 req-ba756148-5e28-42e2-9a8a-2b5f4020986f tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-2499f847-b9e1-4cb7-a51f-ac82de390540 req-ba756148-5e28-42e2-9a8a-2b5f4020986f tempest-TestInstancesWithCinderVolumes-2130655530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a569a67-1c4b-4b83-b1c2-9c503923d6ee', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:55:40 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-2499f847-b9e1-4cb7-a51f-ac82de390540 req-ba756148-5e28-42e2-9a8a-2b5f4020986f tempest-TestInstancesWithCinderVolumes-2130655530 None] attachment_update completed successfully. Nov 06 21:55:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-aea91647-8bdd-403f-8fef-0be735d0e856 req-be54f6e1-dc9f-481b-8765-4e1be2c1571c tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-aea91647-8bdd-403f-8fef-0be735d0e856 req-be54f6e1-dc9f-481b-8765-4e1be2c1571c tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [req-aea91647-8bdd-403f-8fef-0be735d0e856 req-be54f6e1-dc9f-481b-8765-4e1be2c1571c tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-aea91647-8bdd-403f-8fef-0be735d0e856 req-be54f6e1-dc9f-481b-8765-4e1be2c1571c tempest-TestInstancesWithCinderVolumes-2130655530 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373', 'name': 'volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f171086-5c30-4338-95c9-02fc77305510', 'enforce_multipath': True} {{(pid=87069) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 21:55:42 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-aea91647-8bdd-403f-8fef-0be735d0e856 req-be54f6e1-dc9f-481b-8765-4e1be2c1571c tempest-TestInstancesWithCinderVolumes-2130655530 None] attachment_update completed successfully. Nov 06 21:55:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-8c6eee4a-dd2b-4e18-add2-566da6f3b0a3 req-fcf2baa5-9791-4e5c-8751-e6881a4cddd8 tempest-TestInstancesWithCinderVolumes-2130655530 None] Terminate volume connection completed successfully. Nov 06 21:55:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-8c6eee4a-dd2b-4e18-add2-566da6f3b0a3 req-fcf2baa5-9791-4e5c-8751-e6881a4cddd8 tempest-TestInstancesWithCinderVolumes-2130655530 None] Deleting attachment 0a569a67-1c4b-4b83-b1c2-9c503923d6ee. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:55:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "cinder-86ce3b3c-1707-4fef-96bf-1a02482e1fda-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-86ce3b3c-1707-4fef-96bf-1a02482e1fda-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "cinder-quobyte-86ce3b3c-1707-4fef-96bf-1a02482e1fda" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-quobyte-86ce3b3c-1707-4fef-96bf-1a02482e1fda" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b8bf9c-0e81-4d16-9ca0-c1585c8bde1b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:48 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda Nov 06 21:55:48 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:48 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda" returned: 0 in 0.393s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:48 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda Nov 06 21:55:48 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:48 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-86ce3b3c-1707-4fef-96bf-1a02482e1fda" returned: 0 in 0.271s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-quobyte-86ce3b3c-1707-4fef-96bf-1a02482e1fda" released by "delete_volume" :: held 0.714s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:48 devstack cinder-volume[87069]: WARNING cinder.quota [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-521276728-1968950013 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-521276728-1968950013, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:55:48 devstack cinder-volume[87069]: WARNING cinder.quota [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-521276728-1968950013 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-521276728-1968950013, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Created reservations ['0acffcba-b82f-4573-b00f-86a4bbb8e445', 'c8bdeb88-67dc-4911-873c-fa63c5f71b91', 'fa1a44d5-9f3b-443a-941a-2a29657b483a', 'fa751c26-1f03-4a6c-bd69-12aa17d74231'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:48 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:55:48 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:48 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.251s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:55:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Deleted volume successfully. Nov 06 21:55:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-10ee8367-0ab2-4ff7-ba12-46f75566ab54 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-86ce3b3c-1707-4fef-96bf-1a02482e1fda-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:51 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-11bbc9b6-81fc-4bda-9184-c42a202c815e req-52900d4d-df51-41b3-84d1-c7c008da46c1 tempest-TestInstancesWithCinderVolumes-2130655530 None] Terminate volume connection completed successfully. Nov 06 21:55:51 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-11bbc9b6-81fc-4bda-9184-c42a202c815e req-52900d4d-df51-41b3-84d1-c7c008da46c1 tempest-TestInstancesWithCinderVolumes-2130655530 None] Deleting attachment 6f171086-5c30-4338-95c9-02fc77305510. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "cinder-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "cinder-quobyte-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-quobyte-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3b4e42-3503-45a5-bcec-cd9b95c26938]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:52 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f Nov 06 21:55:52 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:52 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f" returned: 0 in 0.374s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:52 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f Nov 06 21:55:52 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:52 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f" returned: 0 in 0.242s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-quobyte-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f" released by "delete_volume" :: held 0.669s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:52 devstack cinder-volume[87069]: WARNING cinder.quota [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1167131527-1635508754 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1167131527-1635508754, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:55:52 devstack cinder-volume[87069]: WARNING cinder.quota [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1167131527-1635508754 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1167131527-1635508754, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Created reservations ['dec7e5bf-df6b-4a62-8ced-c41296ac9663', 'b24c64d6-fa35-4eaa-8e92-c0e3fdb5fe74', 'f83a9bca-e687-4318-a0e7-5e07e3b846f0', '5b79da90-7be3-420a-ae47-93e34085020c'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:52 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:55:52 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:53 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:53 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:55:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Deleted volume successfully. Nov 06 21:55:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7a685ff6-9b03-4522-a1f0-0d0040001bd4 tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-7a5fb348-4e5f-4edd-b056-ace2a93e7f9f-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:55 devstack cinder-volume[87069]: INFO cinder.volume.manager [req-04dab58e-0e02-41ac-b53f-4ca7e624683d req-b84ab275-fff2-43a0-8dae-4bb9aa554a1e tempest-TestInstancesWithCinderVolumes-2130655530 None] Terminate volume connection completed successfully. Nov 06 21:55:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [req-04dab58e-0e02-41ac-b53f-4ca7e624683d req-b84ab275-fff2-43a0-8dae-4bb9aa554a1e tempest-TestInstancesWithCinderVolumes-2130655530 None] Deleting attachment e669053e-58d0-4b0e-8c26-68953e1932e0. {{(pid=87069) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 06 21:55:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "cinder-7996b673-b933-48d0-b910-cb98d2ecc237-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-7996b673-b933-48d0-b910-cb98d2ecc237-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "cinder-quobyte-7996b673-b933-48d0-b910-cb98d2ecc237" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:55:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-quobyte-7996b673-b933-48d0-b910-cb98d2ecc237" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:55:56 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1003caa-f39d-43ff-aa7a-52f770018cd4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:55:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:57 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 Nov 06 21:55:57 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:57 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237" returned: 0 in 0.354s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:57 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237 Nov 06 21:55:57 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:57 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7996b673-b933-48d0-b910-cb98d2ecc237" returned: 0 in 0.253s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-quobyte-7996b673-b933-48d0-b910-cb98d2ecc237" released by "delete_volume" :: held 0.648s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:57 devstack cinder-volume[87069]: WARNING cinder.quota [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1569325052-371541936 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1569325052-371541936, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:55:57 devstack cinder-volume[87069]: WARNING cinder.quota [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1569325052-371541936 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1569325052-371541936, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Created reservations ['7aebd0a0-c79c-4b6f-94d8-1924bbede5ed', '8ba7c0a0-8420-4ee2-9e21-fbfbc18e5680', '0776a685-39b6-4117-a494-96ed2861a73c', '5c4259df-4565-4565-842f-e452e8530d6e'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:57 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:55:57 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:57 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:55:57 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Deleted volume successfully. Nov 06 21:55:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8abe3a53-5082-4fc5-81ee-bc0f6b6b3d6c tempest-TestInstancesWithCinderVolumes-2130655530 None] Lock "cinder-7996b673-b933-48d0-b910-cb98d2ecc237-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:55:58 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:55:58 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:55:58 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.242s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:55:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:56:07 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=30,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:56:07 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=32,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (b17ce044-3ded-448b-b85a-e5b592bcea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e2d05b-ef63-4c59-98c7-189c9a930db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e2d05b-ef63-4c59-98c7-189c9a930db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167899777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ef4acc-9810-4ed5-ab79-4b32aa49dd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:09Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6352187-f160-4bd2-84c6-7c06826857e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6352187-f160-4bd2-84c6-7c06826857e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cf9956-574a-4663-b35b-072668dcf4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cf9956-574a-4663-b35b-072668dcf4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ef4acc-9810-4ed5-ab79-4b32aa49dd17', 'volume_name': 'volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1173fef2-e539-42cc-b953-785e20aa040a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1173fef2-e539-42cc-b953-785e20aa040a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715ce5f0-0bdb-492c-b711-ee726422aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:09 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume 96ef4acc-9810-4ed5-ab79-4b32aa49dd17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17', 'volume_size': 1} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-167899777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ef4acc-9810-4ed5-ab79-4b32aa49dd17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:09Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Creating volume 96ef4acc-9810-4ed5-ab79-4b32aa49dd17 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:09 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:09 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 1073741824 Nov 06 21:56:09 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:09 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 1073741824" returned: 0 in 0.419s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:09 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 Nov 06 21:56:09 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:09 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" returned: 0 in 0.242s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715ce5f0-0bdb-492c-b711-ee726422aba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a69fc3-47f1-43cc-afcf-ac89ccf41e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:10 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 (96ef4acc-9810-4ed5-ab79-4b32aa49dd17): created successfully Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a69fc3-47f1-43cc-afcf-ac89ccf41e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (b17ce044-3ded-448b-b85a-e5b592bcea7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:10 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-08818110-dee8-48fc-8c23-90b03dc16125 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created volume successfully. Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Creating offline snapshot 18e5c1db-c189-4e4b-b54e-d35710230d96 of volume 96ef4acc-9810-4ed5-ab79-4b32aa49dd17 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8e0e70-06ba-483f-88f6-45c6cc556aa3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:10 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 Nov 06 21:56:10 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:10 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" returned: 0 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:10 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 1G Nov 06 21:56:10 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:11 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 1G" returned: 0 in 0.376s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:11 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 Nov 06 21:56:11 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:11 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96" returned: 0 in 0.290s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:11 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 is being set with open permissions: ugo+rw Nov 06 21:56:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:11 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 Nov 06 21:56:11 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:11 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96" returned: 0 in 0.238s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:11 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.info Nov 06 21:56:11 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:11 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.info" returned: 0 in 0.239s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:11 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.info is being set with open permissions: ugo+rw Nov 06 21:56:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:11 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.info Nov 06 21:56:11 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:12 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.info" returned: 0 in 0.235s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:12 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c611495c-2dff-4125-8441-40dd335aa444 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Create snapshot completed successfully Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (4368c992-5b45-4267-8a2b-02e5522beb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7929a10d-b3ea-4a0c-a976-4a8458f0a382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7929a10d-b3ea-4a0c-a976-4a8458f0a382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1762722970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b6f395-7702-4e32-ab1a-96e549f640c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:13Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81188cca-3848-4e7c-8a36-02d575c34c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81188cca-3848-4e7c-8a36-02d575c34c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b67fee2-062f-44d0-a182-060e9b7df3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b67fee2-062f-44d0-a182-060e9b7df3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b6f395-7702-4e32-ab1a-96e549f640c6', 'volume_name': 'volume-24b6f395-7702-4e32-ab1a-96e549f640c6', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133beb78-f705-488f-867e-c6651c5089d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (133beb78-f705-488f-867e-c6651c5089d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd10cf79-7c89-43f1-aa48-24e1b53edf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:12 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume 24b6f395-7702-4e32-ab1a-96e549f640c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b6f395-7702-4e32-ab1a-96e549f640c6', 'volume_size': 1} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1762722970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b6f395-7702-4e32-ab1a-96e549f640c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:13Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Creating volume 24b6f395-7702-4e32-ab1a-96e549f640c6 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:12 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:13 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 1073741824 Nov 06 21:56:13 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (25b0e519-1c4c-4556-8b59-b35c74381e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3594283c-7875-4f29-a1e6-647f8c20cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3594283c-7875-4f29-a1e6-647f8c20cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122294885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54629b1f-2407-4749-8e7d-37015e738ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:13Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c6d3d5-2975-4921-b919-57b1a294089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c6d3d5-2975-4921-b919-57b1a294089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8dd691-b775-4448-a284-4fe6966b819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8dd691-b775-4448-a284-4fe6966b819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54629b1f-2407-4749-8e7d-37015e738ef4', 'volume_name': 'volume-54629b1f-2407-4749-8e7d-37015e738ef4', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef7fdac-1001-4be2-b7c7-ad4e9d5ec787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef7fdac-1001-4be2-b7c7-ad4e9d5ec787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580550be-e404-49fe-aeaa-ac750703eb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume 54629b1f-2407-4749-8e7d-37015e738ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54629b1f-2407-4749-8e7d-37015e738ef4', 'volume_size': 1} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:13 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 1073741824" returned: 0 in 0.523s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:13 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 Nov 06 21:56:13 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (18e2378b-3c8a-4d4b-8dfe-36d94aa6a76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff9851e-42e3-4914-a964-5da43c22bcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff9851e-42e3-4914-a964-5da43c22bcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-626750146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46856cd-4a12-4f10-8ab3-e75f8b61aba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:14Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59a7737-71c7-4c15-9a5e-d3bedecef9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59a7737-71c7-4c15-9a5e-d3bedecef9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7048f8-d8da-4859-a02d-7ed9736ff6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d7048f8-d8da-4859-a02d-7ed9736ff6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46856cd-4a12-4f10-8ab3-e75f8b61aba2', 'volume_name': 'volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a151e9bf-917f-4045-a5d2-923cbed3e4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a151e9bf-917f-4045-a5d2-923cbed3e4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b62b86-7cb2-4f76-816a-d943784054ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume d46856cd-4a12-4f10-8ab3-e75f8b61aba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2', 'volume_size': 1} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:13 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122294885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54629b1f-2407-4749-8e7d-37015e738ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:13Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Creating volume 54629b1f-2407-4749-8e7d-37015e738ef4 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:13 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd10cf79-7c89-43f1-aa48-24e1b53edf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b6f395-7702-4e32-ab1a-96e549f640c6', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 1073741824 Nov 06 21:56:13 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d668460-c897-4600-8198-c5544d3b7143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:13 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume volume-24b6f395-7702-4e32-ab1a-96e549f640c6 (24b6f395-7702-4e32-ab1a-96e549f640c6): created successfully Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d668460-c897-4600-8198-c5544d3b7143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (4368c992-5b45-4267-8a2b-02e5522beb4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c8c4a17b-141f-4f14-996a-e43db85c750e tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created volume successfully. Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (0de80271-dabe-40fb-b7ce-553bb29e767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e576903-1062-429d-ba13-7bc8d39c07c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e576903-1062-429d-ba13-7bc8d39c07c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592261383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b22584b-15a3-4e6f-9626-d3f71935f32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:14Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1749aae-9156-4c85-bf5b-67afa3bc9f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1749aae-9156-4c85-bf5b-67afa3bc9f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86e720e-0dab-4460-9157-5042cf0b1a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86e720e-0dab-4460-9157-5042cf0b1a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b22584b-15a3-4e6f-9626-d3f71935f32b', 'volume_name': 'volume-4b22584b-15a3-4e6f-9626-d3f71935f32b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f50d071-c90c-47c3-8ca5-5a644f9b3571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f50d071-c90c-47c3-8ca5-5a644f9b3571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f36d81-050a-4b5b-be5a-ed81cfd4a41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume 4b22584b-15a3-4e6f-9626-d3f71935f32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b22584b-15a3-4e6f-9626-d3f71935f32b', 'volume_size': 1} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:14 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 1073741824" returned: 0 in 0.533s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:14 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 Nov 06 21:56:14 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (3b1cc0c3-4de4-44ff-a2b7-ae11d21fd826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a808d9-c873-4e1e-856a-f4f643992ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a808d9-c873-4e1e-856a-f4f643992ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834607939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5e3c2b-880e-4d1c-8046-5935c017fa9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:14Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1859d3-98e5-4808-81f7-042c4816f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1859d3-98e5-4808-81f7-042c4816f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d58199-1b13-4445-9dec-6fbd697b058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d58199-1b13-4445-9dec-6fbd697b058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5e3c2b-880e-4d1c-8046-5935c017fa9a', 'volume_name': 'volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f865a992-880f-43ba-93ac-7d933b92595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f865a992-880f-43ba-93ac-7d933b92595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699b550a-a2dd-4376-8dd6-ce2ed7d9583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume dd5e3c2b-880e-4d1c-8046-5935c017fa9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a', 'volume_size': 1} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:14 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-626750146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46856cd-4a12-4f10-8ab3-e75f8b61aba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:14Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Creating volume d46856cd-4a12-4f10-8ab3-e75f8b61aba2 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:14 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:14 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 1073741824 Nov 06 21:56:14 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580550be-e404-49fe-aeaa-ac750703eb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54629b1f-2407-4749-8e7d-37015e738ef4', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3a3380-ce6c-47c9-ae1a-425bdeadacd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume volume-54629b1f-2407-4749-8e7d-37015e738ef4 (54629b1f-2407-4749-8e7d-37015e738ef4): created successfully Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3a3380-ce6c-47c9-ae1a-425bdeadacd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (25b0e519-1c4c-4556-8b59-b35c74381e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2bfab1be-0684-4971-b568-f938f5c93a37 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created volume successfully. Nov 06 21:56:15 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 1073741824" returned: 0 in 0.409s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:15 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 Nov 06 21:56:15 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:15 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2" returned: 0 in 0.243s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.194s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1592261383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b22584b-15a3-4e6f-9626-d3f71935f32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:14Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Creating volume 4b22584b-15a3-4e6f-9626-d3f71935f32b {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:15 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b62b86-7cb2-4f76-816a-d943784054ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae2356f-6a48-459f-89bc-58f327199da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:15 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b 1073741824 Nov 06 21:56:15 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:15 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 (d46856cd-4a12-4f10-8ab3-e75f8b61aba2): created successfully Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae2356f-6a48-459f-89bc-58f327199da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (18e2378b-3c8a-4d4b-8dfe-36d94aa6a76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:15 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b36d4e65-5aa4-4553-9a75-eb4427cc049c tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created volume successfully. Nov 06 21:56:15 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b 1073741824" returned: 0 in 0.420s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:15 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b Nov 06 21:56:15 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:16 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834607939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5e3c2b-880e-4d1c-8046-5935c017fa9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce58f379d7284866bd9a523788f1d786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:14Z,use_quota=True,user_id='28c08847fb9446819e3324951b3844d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Creating volume dd5e3c2b-880e-4d1c-8046-5935c017fa9a {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:16 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f36d81-050a-4b5b-be5a-ed81cfd4a41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b22584b-15a3-4e6f-9626-d3f71935f32b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:16 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a 1073741824 Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b33d57a-191f-435f-84f1-948e9117bfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:16 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:16 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume volume-4b22584b-15a3-4e6f-9626-d3f71935f32b (4b22584b-15a3-4e6f-9626-d3f71935f32b): created successfully Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b33d57a-191f-435f-84f1-948e9117bfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (0de80271-dabe-40fb-b7ce-553bb29e767c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ea9af094-b3ad-4dd7-ae53-dea1e9d48d5d tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created volume successfully. Nov 06 21:56:16 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a 1073741824" returned: 0 in 0.408s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:16 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a Nov 06 21:56:16 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:16 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a" returned: 0 in 0.241s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699b550a-a2dd-4376-8dd6-ce2ed7d9583e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0dd21f-8b80-48b2-b46c-a5451e177923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:16 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Volume volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a (dd5e3c2b-880e-4d1c-8046-5935c017fa9a): created successfully Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a0dd21f-8b80-48b2-b46c-a5451e177923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Flow 'volume_create_manager' (3b1cc0c3-4de4-44ff-a2b7-ae11d21fd826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0b22c2ec-b633-4d48-8186-5ee9903de2b1 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created volume successfully. Nov 06 21:56:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-dd5e3c2b-880e-4d1c-8046-5935c017fa9a-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-dd5e3c2b-880e-4d1c-8046-5935c017fa9a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-quobyte-dd5e3c2b-880e-4d1c-8046-5935c017fa9a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-dd5e3c2b-880e-4d1c-8046-5935c017fa9a" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:17 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bc00af-1d3e-4e1f-9271-f88c905c52a4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:17 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a Nov 06 21:56:17 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:18 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a" returned: 0 in 0.348s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:18 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a Nov 06 21:56:18 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:18 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-dd5e3c2b-880e-4d1c-8046-5935c017fa9a" returned: 0 in 0.242s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-dd5e3c2b-880e-4d1c-8046-5935c017fa9a" released by "delete_volume" :: held 0.631s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created reservations ['58a50806-bf45-4cb8-9a1b-587cb9da8077', 'a891b3a6-ebbc-49d5-9451-cb3693b9086a', '8feeb050-81f4-4cd9-b87d-97a2454aa332', '955af87e-5d52-4cfe-b886-e350a35b8b8e'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:18 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:18 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:18 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.238s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Deleted volume successfully. Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ee5624ed-6d51-4f9f-b197-36674b3421df tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-dd5e3c2b-880e-4d1c-8046-5935c017fa9a-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-4b22584b-15a3-4e6f-9626-d3f71935f32b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-4b22584b-15a3-4e6f-9626-d3f71935f32b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-quobyte-4b22584b-15a3-4e6f-9626-d3f71935f32b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-4b22584b-15a3-4e6f-9626-d3f71935f32b" acquired by "delete_volume" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55341d9-d64b-4c1c-a836-f05304451097]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:19 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b Nov 06 21:56:19 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:19 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b" returned: 0 in 0.349s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:19 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b Nov 06 21:56:19 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:19 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4b22584b-15a3-4e6f-9626-d3f71935f32b" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-4b22584b-15a3-4e6f-9626-d3f71935f32b" released by "delete_volume" :: held 0.626s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created reservations ['bca560d6-79b8-45ef-8d31-fcb9e94b2b55', '1b1a0b95-a21f-4cc8-a08b-503c16b32ae1', 'e09a98c2-3ba6-4a27-8449-a170dd85dfc0', 'ad386fc0-8c63-42ef-8bf6-de5f1b06b4ed'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:19 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:19 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:19 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.234s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Deleted volume successfully. Nov 06 21:56:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4a8403a-baa8-402e-93e6-a5cfe6807b62 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-4b22584b-15a3-4e6f-9626-d3f71935f32b-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-d46856cd-4a12-4f10-8ab3-e75f8b61aba2-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-d46856cd-4a12-4f10-8ab3-e75f8b61aba2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-quobyte-d46856cd-4a12-4f10-8ab3-e75f8b61aba2" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-d46856cd-4a12-4f10-8ab3-e75f8b61aba2" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2479ec9-776e-46be-8074-2be09fee8809]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:20 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 Nov 06 21:56:20 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:20 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:20 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2 Nov 06 21:56:20 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:20 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d46856cd-4a12-4f10-8ab3-e75f8b61aba2" returned: 0 in 0.239s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-d46856cd-4a12-4f10-8ab3-e75f8b61aba2" released by "delete_volume" :: held 0.638s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created reservations ['ccd8b6ec-f06c-481e-bccb-f73ac823bbc8', '4e7a7aee-3fd4-4c9e-a77e-539ad22a808b', '562ccbd4-fa5f-4eb9-9111-00ee161c4e91', '0f68ddf9-2534-44fb-8d39-92856fb7cd0a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:20 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:20 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:21 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.235s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Deleted volume successfully. Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-68ac1015-79b4-4fe5-90f7-f2e0e4b5a55b tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-d46856cd-4a12-4f10-8ab3-e75f8b61aba2-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-54629b1f-2407-4749-8e7d-37015e738ef4-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-54629b1f-2407-4749-8e7d-37015e738ef4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-quobyte-54629b1f-2407-4749-8e7d-37015e738ef4" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-54629b1f-2407-4749-8e7d-37015e738ef4" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[15092795-4da8-4c16-8f64-e60426bc4002]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:21 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 Nov 06 21:56:21 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:21 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4" returned: 0 in 0.346s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:21 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4 Nov 06 21:56:21 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:21 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-54629b1f-2407-4749-8e7d-37015e738ef4" returned: 0 in 0.236s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-54629b1f-2407-4749-8e7d-37015e738ef4" released by "delete_volume" :: held 0.622s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:21 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created reservations ['93c3b8be-0a8e-4936-980a-f41cb97976e4', '46dfa36e-8b0e-4370-afb8-4ecb1794e94f', 'e2d30b45-de81-46c5-a603-8fc992039798', '3a3ff8a7-3fc6-49fb-93d2-bb11c435c0c8'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:22 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:22 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:22 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.231s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Deleted volume successfully. Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dcc1e66f-671e-4d9b-baa1-50e6305310f0 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-54629b1f-2407-4749-8e7d-37015e738ef4-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-24b6f395-7702-4e32-ab1a-96e549f640c6-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-24b6f395-7702-4e32-ab1a-96e549f640c6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-quobyte-24b6f395-7702-4e32-ab1a-96e549f640c6" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-24b6f395-7702-4e32-ab1a-96e549f640c6" acquired by "delete_volume" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c62fa6-52c7-438f-ab81-177ddf075aa5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:22 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 Nov 06 21:56:22 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:22 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6" returned: 0 in 0.354s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:22 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6 Nov 06 21:56:22 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:23 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-24b6f395-7702-4e32-ab1a-96e549f640c6" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-24b6f395-7702-4e32-ab1a-96e549f640c6" released by "delete_volume" :: held 0.634s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created reservations ['d69b1180-3b27-416a-b007-a6812110d3c2', '19b66765-6a43-4799-802f-aee30750d434', '850968c3-bc66-4707-926b-dccec10a1bd4', '6297d764-500b-4e8b-8e1e-19d6e18404cc'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:23 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:23 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:23 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.240s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Deleted volume successfully. Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-11cc3b04-39e1-4963-ba37-cd9e4a7311e3 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-24b6f395-7702-4e32-ab1a-96e549f640c6-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-18e5c1db-c189-4e4b-b54e-d35710230d96-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-18e5c1db-c189-4e4b-b54e-d35710230d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-quobyte-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-quobyte-18e5c1db-c189-4e4b-b54e-d35710230d96" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-18e5c1db-c189-4e4b-b54e-d35710230d96" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Deleting offline snapshot 18e5c1db-c189-4e4b-b54e-d35710230d96 of volume 96ef4acc-9810-4ed5-ab79-4b32aa49dd17 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] snapshot_file for this snap is: volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d75e1f3-31a1-402c-81fe-32617f58bfc2]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:23 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 Nov 06 21:56:23 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:23 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96" returned: 0 in 0.346s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e00a1d6-b979-410b-a7b1-f42bb88b9ed2]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:24 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 Nov 06 21:56:24 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:24 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" returned: 0 in 0.348s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:24 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 Nov 06 21:56:24 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:24 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96" returned: 0 in 0.326s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:24 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96 Nov 06 21:56:24 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:24 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17.18e5c1db-c189-4e4b-b54e-d35710230d96" returned: 0 in 0.241s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-18e5c1db-c189-4e4b-b54e-d35710230d96" released by "_delete_snapshot" :: held 1.369s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" released by "delete_snapshot" :: held 1.390s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:24 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created reservations ['90029bc1-a242-4f0e-bbeb-0ef45f5f5b7b', '8af4f782-32dd-44b0-8b05-cd31f787dcd7', '27e3920f-9fec-4dd0-9810-d7e4a70e98e2', 'f8270a5a-bfb4-4204-8328-52ddc011e687'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Delete snapshot completed successfully. Nov 06 21:56:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-294a9827-f588-41c6-929b-6968f3bcc127 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-18e5c1db-c189-4e4b-b54e-d35710230d96-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-96ef4acc-9810-4ed5-ab79-4b32aa49dd17-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-96ef4acc-9810-4ed5-ab79-4b32aa49dd17-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "cinder-quobyte-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[793e33c8-30e9-4089-959a-a22d8e7a839f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:25 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 Nov 06 21:56:25 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:26 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" returned: 0 in 0.347s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:26 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17 Nov 06 21:56:26 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:26 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" returned: 0 in 0.244s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-quobyte-96ef4acc-9810-4ed5-ab79-4b32aa49dd17" released by "delete_volume" :: held 0.647s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Created reservations ['6eca9826-023c-48e5-88ae-be5e77994ecf', '00686d95-4e95-4dd3-9605-af4e53ebc2e2', '20fb0e7e-28be-4f3f-ac04-b9f6600cafea', 'a9ab3cdc-1935-4c7c-a2dd-9ae329b10c91'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:26 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:26 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:26 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.243s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Deleted volume successfully. Nov 06 21:56:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9c2151b6-9946-4bfa-a09d-67cade7466e7 tempest-CreateVolumesFromSnapshotTest-1361788641 None] Lock "cinder-96ef4acc-9810-4ed5-ab79-4b32aa49dd17-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (07dfc2d5-7089-4df6-bae7-cc24b72f2d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f28cf07-566b-4c1f-9f54-d8bab70a6e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f28cf07-566b-4c1f-9f54-d8bab70a6e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-968058501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4621c6-6605-46e6-8347-29fcc9ca02d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:29Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d22db31-3a6f-4a7a-9015-f1cf3d99a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d22db31-3a6f-4a7a-9015-f1cf3d99a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cf385d-4bdd-4161-9952-ffba1772f5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cf385d-4bdd-4161-9952-ffba1772f5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4621c6-6605-46e6-8347-29fcc9ca02d5', 'volume_name': 'volume-da4621c6-6605-46e6-8347-29fcc9ca02d5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8220f7-f230-4fca-8588-5ddf5fea793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8220f7-f230-4fca-8588-5ddf5fea793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2515845-a466-4332-b1bb-1ffb1a3266af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:29 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume da4621c6-6605-46e6-8347-29fcc9ca02d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4621c6-6605-46e6-8347-29fcc9ca02d5', 'volume_size': 1} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-968058501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4621c6-6605-46e6-8347-29fcc9ca02d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:29Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Creating volume da4621c6-6605-46e6-8347-29fcc9ca02d5 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:29 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:29 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 1073741824 Nov 06 21:56:29 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:29 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 1073741824" returned: 0 in 0.400s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:29 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 Nov 06 21:56:29 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:30 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5" returned: 0 in 0.248s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2515845-a466-4332-b1bb-1ffb1a3266af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4621c6-6605-46e6-8347-29fcc9ca02d5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d24122-e1f2-42f7-9062-33d6f8fedb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:30 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 (da4621c6-6605-46e6-8347-29fcc9ca02d5): created successfully Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d24122-e1f2-42f7-9062-33d6f8fedb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (07dfc2d5-7089-4df6-bae7-cc24b72f2d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-08bdc6fe-556d-4194-86aa-aadf8ba190b0 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created volume successfully. Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (2fc8b56c-df0e-4103-81db-fc633db97780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74516f1c-8546-4816-85bf-77da80514682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74516f1c-8546-4816-85bf-77da80514682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-734708530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:31Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c10f693-a443-4002-896f-93f3af07b247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c10f693-a443-4002-896f-93f3af07b247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89d8128-a541-4122-89fd-9f812ec8f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89d8128-a541-4122-89fd-9f812ec8f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1', 'volume_name': 'volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95935a0-818e-4df1-9f6d-13ee87c88c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95935a0-818e-4df1-9f6d-13ee87c88c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942330bd-2787-4b49-978d-ffbab7fd6074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:30 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume 2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1', 'volume_size': 1} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-734708530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:31Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Creating volume 2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:30 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:30 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 1073741824 Nov 06 21:56:30 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (d9183216-a58c-4098-bfb2-873d9b9a6db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71dd0a5e-7c28-45a3-b4b2-02f060566366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71dd0a5e-7c28-45a3-b4b2-02f060566366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042973927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d74edf-d486-4079-8aa0-7b87b104cb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:31Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54df538-ec10-49f8-9771-76d6258eb18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54df538-ec10-49f8-9771-76d6258eb18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c457a7e1-43fa-4703-9023-d17c202f7cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c457a7e1-43fa-4703-9023-d17c202f7cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d74edf-d486-4079-8aa0-7b87b104cb15', 'volume_name': 'volume-47d74edf-d486-4079-8aa0-7b87b104cb15', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6af681-59fe-40a3-b4fa-e057148cf5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6af681-59fe-40a3-b4fa-e057148cf5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1f2cc2-5267-4d39-b192-24686a1dcb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume 47d74edf-d486-4079-8aa0-7b87b104cb15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d74edf-d486-4079-8aa0-7b87b104cb15', 'volume_size': 1} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:31 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 1073741824" returned: 0 in 0.471s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:31 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 Nov 06 21:56:31 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (fe453f54-1485-4fa2-9db1-d1c695041d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4742b1c-9de0-45af-a553-86a874dd3bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4742b1c-9de0-45af-a553-86a874dd3bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1808097878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4837b534-809b-426b-9f1c-8bea2b61b5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:31Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d721d552-c398-4893-bf74-e6467e144906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d721d552-c398-4893-bf74-e6467e144906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ce645b-cbc3-41f0-807c-5d80f24a9c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ce645b-cbc3-41f0-807c-5d80f24a9c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4837b534-809b-426b-9f1c-8bea2b61b5af', 'volume_name': 'volume-4837b534-809b-426b-9f1c-8bea2b61b5af', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e5e2bc-c32b-471c-84b9-2fac7103542d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e5e2bc-c32b-471c-84b9-2fac7103542d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70a2436-7803-4ced-b452-316936ad007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume 4837b534-809b-426b-9f1c-8bea2b61b5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4837b534-809b-426b-9f1c-8bea2b61b5af', 'volume_size': 1} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:31 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1042973927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d74edf-d486-4079-8aa0-7b87b104cb15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:31Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Creating volume 47d74edf-d486-4079-8aa0-7b87b104cb15 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:31 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:31 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 1073741824 Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942330bd-2787-4b49-978d-ffbab7fd6074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811b59f9-043f-4e49-b64e-543501d89e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 (2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1): created successfully Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811b59f9-043f-4e49-b64e-543501d89e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (2fc8b56c-df0e-4103-81db-fc633db97780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:31 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-34f472d9-cb3c-4295-9519-ebd9a1e6c4f7 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created volume successfully. Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (272bc30c-8221-43fb-9644-2788602404c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a252923-12f8-47de-b9ed-65587d8f8d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a252923-12f8-47de-b9ed-65587d8f8d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-575355970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46842781-b529-43c7-817f-964efb7da930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:32Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ad53e6-6f6f-4d31-8c75-c5119f58460c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ad53e6-6f6f-4d31-8c75-c5119f58460c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21e40aa-aa56-483a-9fa4-108dc77d5948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21e40aa-aa56-483a-9fa4-108dc77d5948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46842781-b529-43c7-817f-964efb7da930', 'volume_name': 'volume-46842781-b529-43c7-817f-964efb7da930', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b529d75-0c5a-45ed-8691-40d40f340712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b529d75-0c5a-45ed-8691-40d40f340712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f50840-af4e-478d-856a-9cd21859e0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume 46842781-b529-43c7-817f-964efb7da930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46842781-b529-43c7-817f-964efb7da930', 'volume_size': 1} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:32 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 1073741824" returned: 0 in 0.516s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:32 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 Nov 06 21:56:32 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (ca1c49ea-ffc5-46d4-9d50-4ee6bcc8fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaf2739-880a-4666-b34c-08d5bb5d28a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaf2739-880a-4666-b34c-08d5bb5d28a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1600272995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f1ff18-0958-44f2-b171-f7c709f632f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:32Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ade4fe-1412-4271-90a2-25795d47ab60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ade4fe-1412-4271-90a2-25795d47ab60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbca6912-228f-4fa7-83ad-41e3824930cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbca6912-228f-4fa7-83ad-41e3824930cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f1ff18-0958-44f2-b171-f7c709f632f5', 'volume_name': 'volume-58f1ff18-0958-44f2-b171-f7c709f632f5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351daeec-683f-4f13-b231-44b644a6b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351daeec-683f-4f13-b231-44b644a6b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8236ff5a-80b7-497a-9073-0ea0505d1ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume 58f1ff18-0958-44f2-b171-f7c709f632f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f1ff18-0958-44f2-b171-f7c709f632f5', 'volume_size': 1} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:32 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1808097878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4837b534-809b-426b-9f1c-8bea2b61b5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:31Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Creating volume 4837b534-809b-426b-9f1c-8bea2b61b5af {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:32 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1f2cc2-5267-4d39-b192-24686a1dcb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d74edf-d486-4079-8aa0-7b87b104cb15', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af 1073741824 Nov 06 21:56:32 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3623008-22e2-4d00-ad06-5a667f4ef173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume volume-47d74edf-d486-4079-8aa0-7b87b104cb15 (47d74edf-d486-4079-8aa0-7b87b104cb15): created successfully Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3623008-22e2-4d00-ad06-5a667f4ef173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (d9183216-a58c-4098-bfb2-873d9b9a6db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-45191b29-4969-46c8-8470-cc50f204e20b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created volume successfully. Nov 06 21:56:32 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af 1073741824" returned: 0 in 0.407s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:33 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af Nov 06 21:56:33 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:33 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af" returned: 0 in 0.234s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-575355970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46842781-b529-43c7-817f-964efb7da930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:32Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Creating volume 46842781-b529-43c7-817f-964efb7da930 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:33 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70a2436-7803-4ced-b452-316936ad007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4837b534-809b-426b-9f1c-8bea2b61b5af', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:33 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 1073741824 Nov 06 21:56:33 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68dba9f-1f20-437c-941a-67f6234b5721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:33 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume volume-4837b534-809b-426b-9f1c-8bea2b61b5af (4837b534-809b-426b-9f1c-8bea2b61b5af): created successfully Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68dba9f-1f20-437c-941a-67f6234b5721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (fe453f54-1485-4fa2-9db1-d1c695041d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:33 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4f692bd9-085a-44f8-be40-4af0800af3b1 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created volume successfully. Nov 06 21:56:33 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 1073741824" returned: 0 in 0.415s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:33 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 Nov 06 21:56:33 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:33 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930" returned: 0 in 0.233s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1600272995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f1ff18-0958-44f2-b171-f7c709f632f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939dc8034f0b4493ac5bd69669cebd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:32Z,use_quota=True,user_id='4920eea1a8454fecb863a70b7f370bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Creating volume 58f1ff18-0958-44f2-b171-f7c709f632f5 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:33 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f50840-af4e-478d-856a-9cd21859e0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46842781-b529-43c7-817f-964efb7da930', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d7823e-af29-4bcb-9eba-558d1b52b634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:33 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 1073741824 Nov 06 21:56:33 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:33 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume volume-46842781-b529-43c7-817f-964efb7da930 (46842781-b529-43c7-817f-964efb7da930): created successfully Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d7823e-af29-4bcb-9eba-558d1b52b634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:33 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (272bc30c-8221-43fb-9644-2788602404c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:33 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0a9a13ee-3fbf-4e39-8482-31ab6b7623c2 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created volume successfully. Nov 06 21:56:34 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 1073741824" returned: 0 in 0.435s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:34 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 Nov 06 21:56:34 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:34 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8236ff5a-80b7-497a-9073-0ea0505d1ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f1ff18-0958-44f2-b171-f7c709f632f5', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7b1e3c-856f-432b-b5d8-e4455b8694a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:34 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Volume volume-58f1ff18-0958-44f2-b171-f7c709f632f5 (58f1ff18-0958-44f2-b171-f7c709f632f5): created successfully Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f7b1e3c-856f-432b-b5d8-e4455b8694a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:34 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Flow 'volume_create_manager' (ca1c49ea-ffc5-46d4-9d50-4ee6bcc8fc21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:34 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9ca2b9ac-1786-4c80-9164-82f3bd541a6a tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created volume successfully. Nov 06 21:56:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-58f1ff18-0958-44f2-b171-f7c709f632f5-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-58f1ff18-0958-44f2-b171-f7c709f632f5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-quobyte-58f1ff18-0958-44f2-b171-f7c709f632f5" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-58f1ff18-0958-44f2-b171-f7c709f632f5" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:35 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[900f10ed-de83-474c-8d2b-3f6db40435e8]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:35 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 Nov 06 21:56:35 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:36 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:36 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5 Nov 06 21:56:36 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:36 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-58f1ff18-0958-44f2-b171-f7c709f632f5" returned: 0 in 0.247s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-58f1ff18-0958-44f2-b171-f7c709f632f5" released by "delete_volume" :: held 0.644s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created reservations ['412a128d-be39-46dd-a548-f09bb0710cce', 'b042d691-5f25-4bda-b6ac-8a22b2b5150a', '21e9d257-471f-4e28-8601-a24fadac9a08', 'd34fc34d-8102-414b-9e12-369c5215f820'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:36 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:36 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:36 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.241s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:36 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Deleted volume successfully. Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6a9e8e1e-ce6f-4961-b4f6-1552e27def6b tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-58f1ff18-0958-44f2-b171-f7c709f632f5-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-46842781-b529-43c7-817f-964efb7da930-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-46842781-b529-43c7-817f-964efb7da930-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-quobyte-46842781-b529-43c7-817f-964efb7da930" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-46842781-b529-43c7-817f-964efb7da930" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d1d4e6-1835-47f0-99c3-bb511c75cd21]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:37 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 Nov 06 21:56:37 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:37 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930" returned: 0 in 0.358s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:37 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930 Nov 06 21:56:37 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:37 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-46842781-b529-43c7-817f-964efb7da930" returned: 0 in 0.236s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-46842781-b529-43c7-817f-964efb7da930" released by "delete_volume" :: held 0.635s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created reservations ['09587c1e-1288-4de3-aa32-813c927a2096', '87c626fd-9675-4e30-afeb-51404855a1fe', '38ace981-332c-4141-b415-dde682c52624', '3d189be5-ce5f-4ab0-9870-974d16e0a7c6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:37 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:37 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:37 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Deleted volume successfully. Nov 06 21:56:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-66b52941-d1b8-4585-ad56-c0f6f1dea7ad tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-46842781-b529-43c7-817f-964efb7da930-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-4837b534-809b-426b-9f1c-8bea2b61b5af-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-4837b534-809b-426b-9f1c-8bea2b61b5af-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-quobyte-4837b534-809b-426b-9f1c-8bea2b61b5af" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-4837b534-809b-426b-9f1c-8bea2b61b5af" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5738df-2aa5-4b55-aa32-44fc87b3177a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:38 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af Nov 06 21:56:38 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:38 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af" returned: 0 in 0.360s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:38 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af Nov 06 21:56:38 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:38 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4837b534-809b-426b-9f1c-8bea2b61b5af" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-4837b534-809b-426b-9f1c-8bea2b61b5af" released by "delete_volume" :: held 0.651s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created reservations ['87aa72e4-7f99-47c9-9f70-d96db5619fcd', '1245b867-a474-4001-80d4-f8fcb14faad3', 'cc6ae637-7c05-44e1-ab6f-fec9003460aa', '1e3e307d-9933-41d6-bd4b-7abdee3b3c4d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:38 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:38 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:39 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.240s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:39 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Deleted volume successfully. Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-5e452290-8a77-4e87-9cbf-284fd77a2907 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-4837b534-809b-426b-9f1c-8bea2b61b5af-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-47d74edf-d486-4079-8aa0-7b87b104cb15-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-47d74edf-d486-4079-8aa0-7b87b104cb15-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-quobyte-47d74edf-d486-4079-8aa0-7b87b104cb15" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-47d74edf-d486-4079-8aa0-7b87b104cb15" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ffd628-dfa9-46e5-ad46-6b5d62aa6e5b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:39 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 Nov 06 21:56:39 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:39 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15" returned: 0 in 0.347s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:39 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15 Nov 06 21:56:39 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:39 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-47d74edf-d486-4079-8aa0-7b87b104cb15" returned: 0 in 0.233s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-47d74edf-d486-4079-8aa0-7b87b104cb15" released by "delete_volume" :: held 0.620s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created reservations ['39268542-4b05-4875-aded-a6a09f7053e1', '8b38526e-d630-45b6-8851-177ccef44cc7', '7e21410b-4512-400e-a6f1-92d4201cb2a6', '8d0271fe-f97f-42d2-bddd-64ef31f1d373'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:40 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:40 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:40 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.240s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:40 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Deleted volume successfully. Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-8973f9dd-76cd-4549-82ad-7764093e1954 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-47d74edf-d486-4079-8aa0-7b87b104cb15-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-quobyte-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14b5b1b-ca7b-4e1c-b95b-4e4df2e6b3f6]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:40 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 Nov 06 21:56:40 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:40 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1" returned: 0 in 0.355s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:40 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1 Nov 06 21:56:40 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:41 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1" released by "delete_volume" :: held 0.630s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created reservations ['7a06a0d6-4cd3-44ee-ad64-8d96f7d8c1f6', 'e9b94b9f-f7be-4fd9-b607-906f0022ee28', 'cd8fd542-5fc7-4a46-9fc6-bc62cdef3921', '6cb5fc59-4532-4b10-8f36-7c8f3d2ee4a6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:41 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:41 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:41 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.244s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:41 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Deleted volume successfully. Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-69b6a9a7-db8e-4208-ab72-d2aa6a4c33a6 tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-2dbb8a05-a5fb-4912-90fc-2931a5c4f8f1-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-da4621c6-6605-46e6-8347-29fcc9ca02d5-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-da4621c6-6605-46e6-8347-29fcc9ca02d5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "cinder-quobyte-da4621c6-6605-46e6-8347-29fcc9ca02d5" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-da4621c6-6605-46e6-8347-29fcc9ca02d5" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3737e34-0817-4084-b955-bbeac6d239c3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:41 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 Nov 06 21:56:41 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:41 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5" returned: 0 in 0.344s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:41 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5 Nov 06 21:56:41 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:42 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-da4621c6-6605-46e6-8347-29fcc9ca02d5" returned: 0 in 0.240s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-quobyte-da4621c6-6605-46e6-8347-29fcc9ca02d5" released by "delete_volume" :: held 0.621s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Created reservations ['b65b378e-f8a1-4f89-be02-050d13ae5cb7', '4a890e0b-38da-4a89-ad54-d613bedb3171', '63dac58b-dfe3-433f-9176-7404614b58a8', '7274e8ef-36dc-464c-be11-03d014a5b623'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:42 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:42 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:42 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.243s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:42 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Deleted volume successfully. Nov 06 21:56:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1af78e0d-9d23-4b5b-9705-96778d40697e tempest-CreateVolumesFromSourceVolumeTest-2079854059 None] Lock "cinder-da4621c6-6605-46e6-8347-29fcc9ca02d5-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Flow 'volume_create_manager' (2103f607-5b29-4a02-869b-725bbd1f1a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429e43db-43af-4fa5-b8e4-ad507bc62ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429e43db-43af-4fa5-b8e4-ad507bc62ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c578a70-28fc-4cc1-97aa-578bf036d67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4c1b901af0476cab8179449db3d8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:45Z,use_quota=True,user_id='648430e482a640bc86317ac9da5b52ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38141d5-2188-4669-b432-efde3b1d6127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38141d5-2188-4669-b432-efde3b1d6127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09469d0a-3bfd-45e6-9139-8109720f0df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09469d0a-3bfd-45e6-9139-8109720f0df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c578a70-28fc-4cc1-97aa-578bf036d67e', 'volume_name': 'volume-2c578a70-28fc-4cc1-97aa-578bf036d67e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338a1bc8-8ad6-430e-98cb-2c399a8bda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338a1bc8-8ad6-430e-98cb-2c399a8bda24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3f4a42-94a3-46d1-a126-2a39cee511ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:45 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Volume 2c578a70-28fc-4cc1-97aa-578bf036d67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c578a70-28fc-4cc1-97aa-578bf036d67e', 'volume_size': 1} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c578a70-28fc-4cc1-97aa-578bf036d67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4c1b901af0476cab8179449db3d8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:45Z,use_quota=True,user_id='648430e482a640bc86317ac9da5b52ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Creating volume 2c578a70-28fc-4cc1-97aa-578bf036d67e {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:45 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:45 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e 1073741824 Nov 06 21:56:45 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:45 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e 1073741824" returned: 0 in 0.416s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:45 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e Nov 06 21:56:45 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:45 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e" returned: 0 in 0.241s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3f4a42-94a3-46d1-a126-2a39cee511ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c578a70-28fc-4cc1-97aa-578bf036d67e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6f0299-add8-43af-8954-d2d51bb962cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:46 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Volume volume-2c578a70-28fc-4cc1-97aa-578bf036d67e (2c578a70-28fc-4cc1-97aa-578bf036d67e): created successfully Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6f0299-add8-43af-8954-d2d51bb962cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Flow 'volume_create_manager' (2103f607-5b29-4a02-869b-725bbd1f1a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6011918c-1be5-4dc2-99a0-bd1204709833 tempest-CinderUnicodeTest-262086171 None] Created volume successfully. Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Flow 'volume_create_manager' (1214f6bc-29c4-4590-a2d0-8f971b57e432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e4017a-9eb1-42bf-9376-35285a06008d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3e4017a-9eb1-42bf-9376-35285a06008d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-696539204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4c1b901af0476cab8179449db3d8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:47Z,use_quota=True,user_id='648430e482a640bc86317ac9da5b52ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7167b4ff-4dee-47d9-87aa-6526433902cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7167b4ff-4dee-47d9-87aa-6526433902cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc987fc-fa84-41a0-9432-3e7f46363099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc987fc-fa84-41a0-9432-3e7f46363099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0', 'volume_name': 'volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87104ac3-89fc-4083-aca5-da00d642d9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87104ac3-89fc-4083-aca5-da00d642d9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b5a0b2-5713-4ce9-9bbd-d96f6695c67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:46 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Volume ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0', 'volume_size': 1} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:56:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-696539204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc4c1b901af0476cab8179449db3d8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:56:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:56:47Z,use_quota=True,user_id='648430e482a640bc86317ac9da5b52ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Creating volume ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:56:46 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:56:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:46 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 1073741824 Nov 06 21:56:46 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:47 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 1073741824" returned: 0 in 0.399s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:47 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 Nov 06 21:56:47 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:47 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b5a0b2-5713-4ce9-9bbd-d96f6695c67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1109dfc5-aa9d-49b8-90be-0d3a1962b95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:56:47 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Volume volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 (ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0): created successfully Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1109dfc5-aa9d-49b8-90be-0d3a1962b95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Flow 'volume_create_manager' (1214f6bc-29c4-4590-a2d0-8f971b57e432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:56:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5db0f143-c5ca-4447-8b2a-1d157d6d551f tempest-CinderUnicodeTest-262086171 None] Created volume successfully. Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Creating offline snapshot 910134c0-3630-4194-8f2c-1733d63a23b7 of volume ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96b23ba-f915-4e90-af4b-8a26de53d2d1]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:48 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 Nov 06 21:56:48 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:48 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" returned: 0 in 0.366s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:48 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 1G Nov 06 21:56:48 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:48 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 1G" returned: 0 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:48 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 Nov 06 21:56:48 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:48 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7" returned: 0 in 0.297s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:48 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 is being set with open permissions: ugo+rw Nov 06 21:56:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:49 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 Nov 06 21:56:49 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:49 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7" returned: 0 in 0.232s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:49 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.info Nov 06 21:56:49 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:49 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.info" returned: 0 in 0.240s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:49 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.info is being set with open permissions: ugo+rw Nov 06 21:56:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:49 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.info Nov 06 21:56:49 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:49 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.info" returned: 0 in 0.235s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ba27157c-18c7-402e-bc52-e32e68616130 tempest-CinderUnicodeTest-262086171 None] Create snapshot completed successfully Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "cinder-910134c0-3630-4194-8f2c-1733d63a23b7-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-910134c0-3630-4194-8f2c-1733d63a23b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "cinder-quobyte-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-quobyte-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "cinder-quobyte-910134c0-3630-4194-8f2c-1733d63a23b7" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-quobyte-910134c0-3630-4194-8f2c-1733d63a23b7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Deleting offline snapshot 910134c0-3630-4194-8f2c-1733d63a23b7 of volume ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] snapshot_file for this snap is: volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f625b6ae-d7ae-4fc8-9e0b-d49f7eff8aa7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:50 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 Nov 06 21:56:50 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:50 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7" returned: 0 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5598d273-c8c4-4c12-8b51-af266ca4edbc]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:50 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 Nov 06 21:56:50 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:50 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" returned: 0 in 0.346s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:50 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 Nov 06 21:56:50 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:51 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7" returned: 0 in 0.330s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:51 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7 Nov 06 21:56:51 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:51 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0.910134c0-3630-4194-8f2c-1733d63a23b7" returned: 0 in 0.252s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-quobyte-910134c0-3630-4194-8f2c-1733d63a23b7" released by "_delete_snapshot" :: held 1.386s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-quobyte-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" released by "delete_snapshot" :: held 1.409s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:51 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Created reservations ['2090d2c2-03bb-4cdd-b90f-aef833d4cbe8', '49e17672-94b4-4d11-9f3e-c5fbae139115', '3c27a26f-0429-4c95-b4d0-f6a0f5557901', 'eabff9d2-a4f9-4f6f-9611-d5f8db50e6c6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:51 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Delete snapshot completed successfully. Nov 06 21:56:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0ed1b771-8209-4782-bee7-7e6e0f944bc6 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-910134c0-3630-4194-8f2c-1733d63a23b7-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "cinder-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "cinder-quobyte-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-quobyte-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc227115-27ca-4d8f-8d81-a4ab935dc21d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:52 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 Nov 06 21:56:52 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:52 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" returned: 0 in 0.375s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:52 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0 Nov 06 21:56:52 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:52 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" returned: 0 in 0.240s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-quobyte-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0" released by "delete_volume" :: held 0.672s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:52 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Created reservations ['afeabfff-337d-4059-a10c-18bd99bb0558', '3d9e6e49-661a-4d28-835a-fba8bb9e5fd3', 'd72ee8b1-e3d3-44f7-b3bf-5e4e811013bd', '00b2c15c-3db1-47ca-913c-61fccb85cc38'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:53 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:53 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:53 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.249s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Deleted volume successfully. Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-be69b370-1eef-4a8b-9a3b-ed0ca9fab040 tempest-CinderUnicodeTest-262086171 None] Lock "cinder-ca1ab1d1-e14c-49b4-a407-c7ea03bc54c0-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Acquiring lock "cinder-2c578a70-28fc-4cc1-97aa-578bf036d67e-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Lock "cinder-2c578a70-28fc-4cc1-97aa-578bf036d67e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Acquiring lock "cinder-quobyte-2c578a70-28fc-4cc1-97aa-578bf036d67e" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Lock "cinder-quobyte-2c578a70-28fc-4cc1-97aa-578bf036d67e" acquired by "delete_volume" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ab8f51-9a7e-4b12-a176-66be1480fc71]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:53 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e Nov 06 21:56:53 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:53 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e" returned: 0 in 0.362s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:53 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e Nov 06 21:56:53 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:54 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2c578a70-28fc-4cc1-97aa-578bf036d67e" returned: 0 in 0.236s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Lock "cinder-quobyte-2c578a70-28fc-4cc1-97aa-578bf036d67e" released by "delete_volume" :: held 0.637s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Created reservations ['fdb33ecb-8194-410d-a224-128f8566cbf9', 'c88e2661-a38c-42fc-a903-2cc03a0a2ac8', '82458255-bc0a-4065-abf4-0204d6cf32fa', 'e01eda71-623a-4349-9a28-22e7893d49f5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:54 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:54 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:54 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.251s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Deleted volume successfully. Nov 06 21:56:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-26e9eaa5-e20b-433f-9fbb-beab3f5bb42e tempest-CinderUnicodeTest-262086171 None] Lock "cinder-2c578a70-28fc-4cc1-97aa-578bf036d67e-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:56:58 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:56:58 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:56:58 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:56:58 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:56:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:56:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:56:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:57:04 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=123,cinder:UPDATE=180,cinder:INSERT=40,cinder:DELETE=17 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:57:04 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=109,cinder:UPDATE=156,cinder:INSERT=40,cinder:DELETE=13 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (47be3288-af11-49cd-9bc2-09b5ddaea888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87062991-9d26-434d-8a53-b3e49bff5e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87062991-9d26-434d-8a53-b3e49bff5e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962774418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1e7f6f-6cfd-4ca6-ac00-103c1957a346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:06Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bd0ba0-2599-4945-b69e-45c96e335707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bd0ba0-2599-4945-b69e-45c96e335707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d03d91-1972-4057-89cb-c81489fde21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d03d91-1972-4057-89cb-c81489fde21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1e7f6f-6cfd-4ca6-ac00-103c1957a346', 'volume_name': 'volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9e5dd7-3e11-4366-8559-90085d7f4a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9e5dd7-3e11-4366-8559-90085d7f4a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5e9df1-86e4-48b3-b8d6-b7191c2ca636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Volume 0e1e7f6f-6cfd-4ca6-ac00-103c1957a346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346', 'volume_size': 1} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1962774418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e1e7f6f-6cfd-4ca6-ac00-103c1957a346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:06Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Creating volume 0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:06 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:06 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 1073741824 Nov 06 21:57:06 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (4879f6ad-6e11-4381-b47c-8dcb4b08eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3275e4cd-2f41-46cd-b99c-ddca6a2d78a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (c91af6a2-67d0-4a34-bdb8-64a34537de7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bac7526-ef3e-4cbe-8bf1-21cd7e4b2369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3275e4cd-2f41-46cd-b99c-ddca6a2d78a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672576871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3645c694-9518-41ef-9102-c1d1faa928c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:06Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d4d9d5-8c5e-4a83-ba4f-41af867b8c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d4d9d5-8c5e-4a83-ba4f-41af867b8c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8c4fd4-0bd3-469f-9342-8969f61c5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8c4fd4-0bd3-469f-9342-8969f61c5245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3645c694-9518-41ef-9102-c1d1faa928c0', 'volume_name': 'volume-3645c694-9518-41ef-9102-c1d1faa928c0', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924d8f94-e87d-4e92-b2bb-862dc78bf188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924d8f94-e87d-4e92-b2bb-862dc78bf188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa7fa09-98b7-4a3e-a56f-6f3ad20476c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume 3645c694-9518-41ef-9102-c1d1faa928c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3645c694-9518-41ef-9102-c1d1faa928c0', 'volume_size': 1} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bac7526-ef3e-4cbe-8bf1-21cd7e4b2369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1672225105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ccf190-2e90-4dad-bb5c-894a3feeff2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:07Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4044e6c-e9e8-464f-a0af-32f7bf65206e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4044e6c-e9e8-464f-a0af-32f7bf65206e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa398b8-735f-4135-a52e-886609a2fbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa398b8-735f-4135-a52e-886609a2fbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ccf190-2e90-4dad-bb5c-894a3feeff2b', 'volume_name': 'volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b2bd5c-5247-4c1b-87b7-cd6b351c92db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b2bd5c-5247-4c1b-87b7-cd6b351c92db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec39316d-e49b-4149-b464-b77fe34640cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:06 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Volume 48ccf190-2e90-4dad-bb5c-894a3feeff2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b', 'volume_size': 1} Nov 06 21:57:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (b76d336f-7f43-410c-8832-43e7fddaa835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4972fa-5312-471a-b632-c54d6b1b273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4972fa-5312-471a-b632-c54d6b1b273b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360249823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfef17f-c800-43be-aa25-53ad3ea90254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:07Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29d24e5-5b60-4f71-a1a7-6951054d4a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f29d24e5-5b60-4f71-a1a7-6951054d4a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5865016-08cb-4483-8f45-b8522b9dabb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5865016-08cb-4483-8f45-b8522b9dabb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcfef17f-c800-43be-aa25-53ad3ea90254', 'volume_name': 'volume-bcfef17f-c800-43be-aa25-53ad3ea90254', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c7c2ed-deeb-4c85-a2c1-f99a0ac1a694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c7c2ed-deeb-4c85-a2c1-f99a0ac1a694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeda5f54-465d-412e-bd34-fed02ff8251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume bcfef17f-c800-43be-aa25-53ad3ea90254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcfef17f-c800-43be-aa25-53ad3ea90254', 'volume_size': 1} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:07 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (1396271e-b462-4455-a207-6c898b9edd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6130bc9-e3fb-45c9-9acb-6e19cd6ba55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 1073741824" returned: 0 in 0.751s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6130bc9-e3fb-45c9-9acb-6e19cd6ba55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-77624140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e62ca9-7a97-42ca-b022-51abd2cee90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:07Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3758a084-406f-4e07-ba71-3298139a3e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3758a084-406f-4e07-ba71-3298139a3e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b552f387-1a0e-47bd-b2b3-294dcfa818e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b552f387-1a0e-47bd-b2b3-294dcfa818e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e62ca9-7a97-42ca-b022-51abd2cee90d', 'volume_name': 'volume-44e62ca9-7a97-42ca-b022-51abd2cee90d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5fcef0-a819-4198-bd9b-0f664bedab8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa5fcef0-a819-4198-bd9b-0f664bedab8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f0e1d5-7f42-4955-ab36-0deff9ef1514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Volume 44e62ca9-7a97-42ca-b022-51abd2cee90d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e62ca9-7a97-42ca-b022-51abd2cee90d', 'volume_size': 1} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:07 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 Nov 06 21:57:07 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (a7064dfe-6d8b-4842-89b1-af243af01093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67d435a-3ed8-457c-93ad-2bb5a43cb552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d67d435a-3ed8-457c-93ad-2bb5a43cb552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302201765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c32461-0599-4594-97e5-61310c6fd782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:08Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a848c05-2a4c-43b6-8c8c-6952d643bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a848c05-2a4c-43b6-8c8c-6952d643bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcae938-0ff4-4174-afb9-f943ee6e42d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffcae938-0ff4-4174-afb9-f943ee6e42d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c32461-0599-4594-97e5-61310c6fd782', 'volume_name': 'volume-26c32461-0599-4594-97e5-61310c6fd782', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f0b372-f640-4c1d-b6dc-c6f23469767a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f0b372-f640-4c1d-b6dc-c6f23469767a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f214751-eb29-4233-ab9e-16b0fcac0077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Volume 26c32461-0599-4594-97e5-61310c6fd782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c32461-0599-4594-97e5-61310c6fd782', 'volume_size': 1} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:07 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346" returned: 0 in 0.397s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.077s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672576871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3645c694-9518-41ef-9102-c1d1faa928c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:06Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Creating volume 3645c694-9518-41ef-9102-c1d1faa928c0 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:07 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5e9df1-86e4-48b3-b8d6-b7191c2ca636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:07 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 1073741824 Nov 06 21:57:07 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b03b43e-207a-49da-8f3c-763a2f735978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:07 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Volume volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 (0e1e7f6f-6cfd-4ca6-ac00-103c1957a346): created successfully Nov 06 21:57:07 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b03b43e-207a-49da-8f3c-763a2f735978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (47be3288-af11-49cd-9bc2-09b5ddaea888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-17cb2ea1-079f-4ce3-a933-374237c4cc88 tempest-CreateVolumesFromImageTest-793653821 None] Created volume successfully. Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (b18ae78e-2d6d-43de-b6f1-f1ea849ece8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d197d2-cde6-42b6-a9c7-a152e91bab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d197d2-cde6-42b6-a9c7-a152e91bab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58463276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17edec74-221a-4c64-904c-7bc25fbdbd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:08Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72309a71-a8a5-443c-9304-bdf23f80d277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72309a71-a8a5-443c-9304-bdf23f80d277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ff73cb-6185-436c-8ae7-27634fae9414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ff73cb-6185-436c-8ae7-27634fae9414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17edec74-221a-4c64-904c-7bc25fbdbd3b', 'volume_name': 'volume-17edec74-221a-4c64-904c-7bc25fbdbd3b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9895e57-c8c9-4ffa-81cb-88d8a13b77cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9895e57-c8c9-4ffa-81cb-88d8a13b77cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2d57d3-f92e-4225-aa5e-fa3486633a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:08 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Volume 17edec74-221a-4c64-904c-7bc25fbdbd3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17edec74-221a-4c64-904c-7bc25fbdbd3b', 'volume_size': 1} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:08 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 1073741824" returned: 0 in 0.500s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:08 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 Nov 06 21:57:08 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:08 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1672225105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ccf190-2e90-4dad-bb5c-894a3feeff2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:07Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Creating volume 48ccf190-2e90-4dad-bb5c-894a3feeff2b {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:08 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efa7fa09-98b7-4a3e-a56f-6f3ad20476c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3645c694-9518-41ef-9102-c1d1faa928c0', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:08 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b 1073741824 Nov 06 21:57:08 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbf171a-26f9-4805-8794-ea2134526ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:08 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume volume-3645c694-9518-41ef-9102-c1d1faa928c0 (3645c694-9518-41ef-9102-c1d1faa928c0): created successfully Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dbf171a-26f9-4805-8794-ea2134526ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:08 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (4879f6ad-6e11-4381-b47c-8dcb4b08eb90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-45d725d7-cd38-403f-a362-9eb0e0b169b9 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created volume successfully. Nov 06 21:57:09 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b 1073741824" returned: 0 in 0.487s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:09 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b Nov 06 21:57:09 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:09 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b" returned: 0 in 0.254s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.216s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360249823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcfef17f-c800-43be-aa25-53ad3ea90254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:07Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Creating volume bcfef17f-c800-43be-aa25-53ad3ea90254 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:09 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:09 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 1073741824 Nov 06 21:57:09 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec39316d-e49b-4149-b464-b77fe34640cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19f99bf-2dd7-4ba2-bb1c-0851b2f4fa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:09 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Volume volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b (48ccf190-2e90-4dad-bb5c-894a3feeff2b): created successfully Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19f99bf-2dd7-4ba2-bb1c-0851b2f4fa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (c91af6a2-67d0-4a34-bdb8-64a34537de7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:09 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-90cf9a82-5293-4745-8117-5321558b4cda tempest-CreateVolumesFromImageTest-793653821 None] Created volume successfully. Nov 06 21:57:10 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 1073741824" returned: 0 in 0.549s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (de5f8dd5-b4d5-4b85-a565-10ff44614df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb8a725-a358-48b3-acff-1bd8bd401fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb8a725-a358-48b3-acff-1bd8bd401fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-916545640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbfda3f-e44c-418b-b636-67f9265f74b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:10Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 Nov 06 21:57:10 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2ae4cc-5ae4-47df-9e75-6fd31635a507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2ae4cc-5ae4-47df-9e75-6fd31635a507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce52509d-df27-4209-b1fe-a4f127dbcbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce52509d-df27-4209-b1fe-a4f127dbcbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbfda3f-e44c-418b-b636-67f9265f74b9', 'volume_name': 'volume-1dbfda3f-e44c-418b-b636-67f9265f74b9', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f568a4bc-438e-4978-b59a-e5cd6b5bdfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f568a4bc-438e-4978-b59a-e5cd6b5bdfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1284b48a-05ea-46ea-a053-d488ded0e90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume 1dbfda3f-e44c-418b-b636-67f9265f74b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbfda3f-e44c-418b-b636-67f9265f74b9', 'volume_size': 1} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:10 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254" returned: 0 in 0.301s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-77624140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e62ca9-7a97-42ca-b022-51abd2cee90d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:07Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Creating volume 44e62ca9-7a97-42ca-b022-51abd2cee90d {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:10 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:10 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d 1073741824 Nov 06 21:57:10 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeda5f54-465d-412e-bd34-fed02ff8251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcfef17f-c800-43be-aa25-53ad3ea90254', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7dca3ec-1b2c-45e8-87d6-b3642940a427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume volume-bcfef17f-c800-43be-aa25-53ad3ea90254 (bcfef17f-c800-43be-aa25-53ad3ea90254): created successfully Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7dca3ec-1b2c-45e8-87d6-b3642940a427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (b76d336f-7f43-410c-8832-43e7fddaa835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:10 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8d2cb1a7-a792-4c57-9ff6-4492746f5231 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created volume successfully. Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (73e031fc-b586-4a21-b4ab-504e7c7797c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f518a4-a68d-4b91-bbf0-361e82ff3ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f518a4-a68d-4b91-bbf0-361e82ff3ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302720061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209334c3-7c80-4913-aaa7-2b971082fcb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:11Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f95ee52-5896-4926-bea7-d9683e84902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f95ee52-5896-4926-bea7-d9683e84902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb391e0-13e6-404f-938f-a330870150d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb391e0-13e6-404f-938f-a330870150d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209334c3-7c80-4913-aaa7-2b971082fcb7', 'volume_name': 'volume-209334c3-7c80-4913-aaa7-2b971082fcb7', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c862eb8-a4e4-4c5e-9a9d-79ea74665f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c862eb8-a4e4-4c5e-9a9d-79ea74665f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a19c62-6291-4800-a918-537b933631ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume 209334c3-7c80-4913-aaa7-2b971082fcb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209334c3-7c80-4913-aaa7-2b971082fcb7', 'volume_size': 1} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Flow 'volume_create_manager' (9487921d-e2bb-46ed-9a3d-6d88bca611a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b105a45b-2dff-401b-ae95-bcbccf98af5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b105a45b-2dff-401b-ae95-bcbccf98af5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7366576e-7f21-4410-9fc4-98e9c6eab139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8f42708194e6f9f86230da9cd4f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:11Z,use_quota=True,user_id='78bb082837c648a7a5c3843ea585bd94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3b3827c-1e03-477c-882f-1becfe78d635),volume_type_id=c3b3827c-1e03-477c-882f-1becfe78d635)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd167287-5d1a-4b57-bb6a-9458cd3fb3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd167287-5d1a-4b57-bb6a-9458cd3fb3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89b807f-aac0-49e6-b9aa-5ab731b9cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:10 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:57:11 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d 1073741824" returned: 0 in 0.548s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (4cb7cce1-0152-42a9-8d05-2e8094bfe0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b74dde5-29e1-4d89-95b2-c4b9e7a3d0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b74dde5-29e1-4d89-95b2-c4b9e7a3d0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-103752361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08c8366-358a-4c74-a546-82dc46b12c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:11Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b728ed-c99c-4563-9a18-c7d97d497a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b728ed-c99c-4563-9a18-c7d97d497a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb5a4b8-718f-4ac4-815e-f3fcd12893f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb5a4b8-718f-4ac4-815e-f3fcd12893f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08c8366-358a-4c74-a546-82dc46b12c47', 'volume_name': 'volume-d08c8366-358a-4c74-a546-82dc46b12c47', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05047bf3-2120-4281-b53e-06a38ab56e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05047bf3-2120-4281-b53e-06a38ab56e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b731524-eab2-445b-bfaa-76f255b60ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume d08c8366-358a-4c74-a546-82dc46b12c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08c8366-358a-4c74-a546-82dc46b12c47', 'volume_size': 1} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:11 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d Nov 06 21:57:11 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89b807f-aac0-49e6-b9aa-5ab731b9cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7366576e-7f21-4410-9fc4-98e9c6eab139', 'volume_name': 'volume-7366576e-7f21-4410-9fc4-98e9c6eab139', 'volume_size': 1, 'image_id': '91647a62-59c0-40db-b90c-6b8334363717', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91647a62-59c0-40db-b90c-6b8334363717', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e50cbf99c240e3ee135cdb0daab06a12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43f8f42708194e6f9f86230da9cd4f0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca055828ff611e44eafc662f7110170986b731f50ca80f927c66051edc64cf9aa9066697498d237b91fcb82a4a4e4959ae4210616a845685414f0c31ad0d89b', 'id': '91647a62-59c0-40db-b90c-6b8334363717', 'created_at': datetime.datetime(2026, 11, 6, 20, 57, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 57, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91647a62-59c0-40db-b90c-6b8334363717/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3342f027-3667-46f6-91c2-2fb6c1d15122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3342f027-3667-46f6-91c2-2fb6c1d15122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ab1975-5c20-44ca-abd9-37fa0090ab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Volume 7366576e-7f21-4410-9fc4-98e9c6eab139: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7366576e-7f21-4410-9fc4-98e9c6eab139', 'volume_size': 1, 'image_id': '91647a62-59c0-40db-b90c-6b8334363717', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91647a62-59c0-40db-b90c-6b8334363717', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e50cbf99c240e3ee135cdb0daab06a12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43f8f42708194e6f9f86230da9cd4f0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca055828ff611e44eafc662f7110170986b731f50ca80f927c66051edc64cf9aa9066697498d237b91fcb82a4a4e4959ae4210616a845685414f0c31ad0d89b', 'id': '91647a62-59c0-40db-b90c-6b8334363717', 'created_at': datetime.datetime(2026, 11, 6, 20, 57, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 57, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91647a62-59c0-40db-b90c-6b8334363717/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Trying to clone 7366576e-7f21-4410-9fc4-98e9c6eab139 from image 91647a62-59c0-40db-b90c-6b8334363717 at location (None, [{'url': 'file:///opt/stack/data/glance/images/91647a62-59c0-40db-b90c-6b8334363717', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:11 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (f32c3722-cced-40a8-90dc-08dd442c5d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55200319-ccd2-4bde-a9c5-cb2d84f4bd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d" returned: 0 in 0.324s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.762s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302201765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c32461-0599-4594-97e5-61310c6fd782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:08Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Creating volume 26c32461-0599-4594-97e5-61310c6fd782 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:11 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:57:11 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55200319-ccd2-4bde-a9c5-cb2d84f4bd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2079808206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51948b4-19ce-45a4-bda5-2b9ff3b60566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:11Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7d5e7e-7edf-4820-8b13-cdc128182e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 1073741824 Nov 06 21:57:11 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7d5e7e-7edf-4820-8b13-cdc128182e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0c827c-37a0-4903-8ad6-5c5925af9753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0c827c-37a0-4903-8ad6-5c5925af9753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51948b4-19ce-45a4-bda5-2b9ff3b60566', 'volume_name': 'volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0e076d-a821-460b-b5c1-e58bac3cf832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0e076d-a821-460b-b5c1-e58bac3cf832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd1904f-a601-425a-a649-c26d19b9f633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume b51948b4-19ce-45a4-bda5-2b9ff3b60566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566', 'volume_size': 1} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f0e1d5-7f42-4955-ab36-0deff9ef1514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e62ca9-7a97-42ca-b022-51abd2cee90d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4af80c-d440-467a-8ca0-22d7da3d5c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:11 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Volume volume-44e62ca9-7a97-42ca-b022-51abd2cee90d (44e62ca9-7a97-42ca-b022-51abd2cee90d): created successfully Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4af80c-d440-467a-8ca0-22d7da3d5c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (1396271e-b462-4455-a207-6c898b9edd26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d88aa3-8c4e-4cc5-ba2d-3922af395371]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e15be932-3db4-45c5-8d83-873494df00b9 tempest-CreateVolumesFromImageTest-793653821 None] Created volume successfully. Nov 06 21:57:11 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD Nov 06 21:57:11 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (d7485222-91c4-4436-817c-944cd61103b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e974558-f548-4dee-a839-a213bac37e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e974558-f548-4dee-a839-a213bac37e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-908688857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99949382-3042-46c7-8c20-29b4ee8ba6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:12Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c76888-2497-4b27-854f-5fc503869c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:12 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c76888-2497-4b27-854f-5fc503869c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc337db3-34c8-4c30-88f1-ee9689aac562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc337db3-34c8-4c30-88f1-ee9689aac562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99949382-3042-46c7-8c20-29b4ee8ba6a8', 'volume_name': 'volume-99949382-3042-46c7-8c20-29b4ee8ba6a8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b51631-6391-4622-b6bb-cdab39853a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b51631-6391-4622-b6bb-cdab39853a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5b36d4-3e96-4021-a53a-64a701d4799c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:12 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume 99949382-3042-46c7-8c20-29b4ee8ba6a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99949382-3042-46c7-8c20-29b4ee8ba6a8', 'volume_size': 1} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 1073741824" returned: 0 in 0.625s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:12 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:12 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 Nov 06 21:57:12 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:12 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD Nov 06 21:57:12 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:12 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782" returned: 0 in 0.253s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.298s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-58463276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17edec74-221a-4c64-904c-7bc25fbdbd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66ae8765674c50b426b5f1c55a95c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:08Z,use_quota=True,user_id='b2d33358f04945de8536f1d0007eb879',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Creating volume 17edec74-221a-4c64-904c-7bc25fbdbd3b {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:12 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f214751-eb29-4233-ab9e-16b0fcac0077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c32461-0599-4594-97e5-61310c6fd782', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:12 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b 1073741824 Nov 06 21:57:12 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdb3d9c-cc99-4dff-8be5-c73c4e788ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:12 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Volume volume-26c32461-0599-4594-97e5-61310c6fd782 (26c32461-0599-4594-97e5-61310c6fd782): created successfully Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cdb3d9c-cc99-4dff-8be5-c73c4e788ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (a7064dfe-6d8b-4842-89b1-af243af01093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:12 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-05e5ef3a-5335-451f-a74e-e6e2f1ece353 tempest-CreateVolumesFromImageTest-793653821 None] Created volume successfully. Nov 06 21:57:12 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Temporary image 91647a62-59c0-40db-b90c-6b8334363717 is fetched for user 78bb082837c648a7a5c3843ea585bd94. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8d78af-383b-486a-9f31-65b0cd9a18fb]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:12 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD Nov 06 21:57:12 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:12 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:12 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b 1073741824" returned: 0 in 0.550s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:13 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b Nov 06 21:57:13 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:13 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD Nov 06 21:57:13 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:13 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b" returned: 0 in 0.249s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.027s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-916545640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbfda3f-e44c-418b-b636-67f9265f74b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:10Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Creating volume 1dbfda3f-e44c-418b-b636-67f9265f74b9 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:13 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:13 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2d57d3-f92e-4225-aa5e-fa3486633a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17edec74-221a-4c64-904c-7bc25fbdbd3b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:13 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 1073741824 Nov 06 21:57:13 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd71a435-25a3-4707-bbef-bb138d4b4bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:13 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Volume volume-17edec74-221a-4c64-904c-7bc25fbdbd3b (17edec74-221a-4c64-904c-7bc25fbdbd3b): created successfully Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd71a435-25a3-4707-bbef-bb138d4b4bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Flow 'volume_create_manager' (b18ae78e-2d6d-43de-b6f1-f1ea849ece8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6afa3c17-a9f8-47ef-8e24-7bcacd5fbbb8 tempest-CreateVolumesFromImageTest-793653821 None] Created volume successfully. Nov 06 21:57:13 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 1073741824" returned: 0 in 0.407s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:13 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 Nov 06 21:57:13 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:13 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9" returned: 0 in 0.271s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.134s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302720061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209334c3-7c80-4913-aaa7-2b971082fcb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:11Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Creating volume 209334c3-7c80-4913-aaa7-2b971082fcb7 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:14 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1284b48a-05ea-46ea-a053-d488ded0e90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbfda3f-e44c-418b-b636-67f9265f74b9', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:14 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 1073741824 Nov 06 21:57:14 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1546d135-762f-4838-b68d-d170cfb838a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 (1dbfda3f-e44c-418b-b636-67f9265f74b9): created successfully Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1546d135-762f-4838-b68d-d170cfb838a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (de5f8dd5-b4d5-4b85-a565-10ff44614df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-17edec74-221a-4c64-904c-7bc25fbdbd3b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-93821293-6dac-4551-a16d-27242f74847e tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created volume successfully. Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-17edec74-221a-4c64-904c-7bc25fbdbd3b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-quobyte-17edec74-221a-4c64-904c-7bc25fbdbd3b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-17edec74-221a-4c64-904c-7bc25fbdbd3b" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b9c696-6131-44f6-a1ba-1ba6b400ec6f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:14 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b Nov 06 21:57:14 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:14 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 1073741824" returned: 0 in 0.469s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:14 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 Nov 06 21:57:14 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:14 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b" returned: 0 in 0.404s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:14 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b Nov 06 21:57:14 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:14 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7" returned: 0 in 0.258s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.639s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-103752361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08c8366-358a-4c74-a546-82dc46b12c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:11Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Creating volume d08c8366-358a-4c74-a546-82dc46b12c47 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:14 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:14 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a19c62-6291-4800-a918-537b933631ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209334c3-7c80-4913-aaa7-2b971082fcb7', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:14 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 1073741824 Nov 06 21:57:14 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b9eb4a-d04d-4034-8dc7-98e8741febe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-17edec74-221a-4c64-904c-7bc25fbdbd3b" returned: 0 in 0.258s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-17edec74-221a-4c64-904c-7bc25fbdbd3b" released by "delete_volume" :: held 0.711s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume volume-209334c3-7c80-4913-aaa7-2b971082fcb7 (209334c3-7c80-4913-aaa7-2b971082fcb7): created successfully Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0b9eb4a-d04d-4034-8dc7-98e8741febe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (73e031fc-b586-4a21-b4ab-504e7c7797c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9ff4b23c-46e0-48e6-940e-0171e90363fe tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created volume successfully. Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Created reservations ['731a277b-0c5c-4a23-900b-71d5f75e6def', '0a0c743c-06cd-4e9f-bfff-1c5375de1ac7', '65cc3c6a-053b-4a0b-9488-a81f02712e47', '43a65f32-23a3-413e-8e7d-51b0b5676fd8'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:15 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:15 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-26c32461-0599-4594-97e5-61310c6fd782-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:15 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.300s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:15 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Deleted volume successfully. Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-26c32461-0599-4594-97e5-61310c6fd782-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a4c793f6-0233-4cdf-99d9-91f87d6f5378 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-17edec74-221a-4c64-904c-7bc25fbdbd3b-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-quobyte-26c32461-0599-4594-97e5-61310c6fd782" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:15 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 1073741824" returned: 0 in 0.585s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-26c32461-0599-4594-97e5-61310c6fd782" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf47e2b-8934-4991-96cd-d72ee65bc23a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:15 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 Nov 06 21:57:15 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:15 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 Nov 06 21:57:15 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:15 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47" returned: 0 in 0.252s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.074s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2079808206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51948b4-19ce-45a4-bda5-2b9ff3b60566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:11Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Creating volume b51948b4-19ce-45a4-bda5-2b9ff3b60566 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:15 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b731524-eab2-445b-bfaa-76f255b60ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08c8366-358a-4c74-a546-82dc46b12c47', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:15 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 1073741824 Nov 06 21:57:15 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873bee2a-8d99-4f5f-91bd-bf32b75e41e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:15 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume volume-d08c8366-358a-4c74-a546-82dc46b12c47 (d08c8366-358a-4c74-a546-82dc46b12c47): created successfully Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (873bee2a-8d99-4f5f-91bd-bf32b75e41e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (4cb7cce1-0152-42a9-8d05-2e8094bfe0e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:15 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-57e5153f-893c-43d2-b57f-084f5364ca77 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created volume successfully. Nov 06 21:57:15 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:15 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782 Nov 06 21:57:15 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:16 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-26c32461-0599-4594-97e5-61310c6fd782" returned: 0 in 0.285s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-26c32461-0599-4594-97e5-61310c6fd782" released by "delete_volume" :: held 0.709s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Created reservations ['031dcb3a-b657-4864-b059-c1fefea01579', 'a634e98b-553a-4933-be08-95011a9180fc', '462fc78c-6f7d-4b50-96f0-37f6af8c571c', 'f1cb0ea0-d18d-4716-b16a-55bd5bbfe8af'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:16 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 1073741824" returned: 0 in 0.453s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:16 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 Nov 06 21:57:16 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:16 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:16 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-44e62ca9-7a97-42ca-b022-51abd2cee90d-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:16 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566" returned: 0 in 0.277s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-44e62ca9-7a97-42ca-b022-51abd2cee90d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.454s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:16 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd1904f-a601-425a-a649-c26d19b9f633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e7b96-5b60-432a-afd6-726086b28f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.288s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Creating offline snapshot 391686de-bee6-4e29-a364-2d0eecb35f5e of volume bcfef17f-c800-43be-aa25-53ad3ea90254 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Deleted volume successfully. Nov 06 21:57:16 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 (b51948b4-19ce-45a4-bda5-2b9ff3b60566): created successfully Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76e7b96-5b60-432a-afd6-726086b28f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (f32c3722-cced-40a8-90dc-08dd442c5d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f478e25-d738-4561-8e21-b727f995b005]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:16 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-90f6b43d-eafe-46a1-a2cf-80cf62e953f5 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created volume successfully. Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-72e43091-b308-4637-a37b-92febc4fefe7 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-26c32461-0599-4594-97e5-61310c6fd782-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-quobyte-44e62ca9-7a97-42ca-b022-51abd2cee90d" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-44e62ca9-7a97-42ca-b022-51abd2cee90d" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd96b22-f2a4-4349-86a9-fcf57e4c2ba7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:16 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 Nov 06 21:57:16 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:16 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d Nov 06 21:57:16 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:16 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254" returned: 0 in 0.380s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:16 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e 1G Nov 06 21:57:16 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:17 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d" returned: 0 in 0.383s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:17 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d Nov 06 21:57:17 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:17 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-44e62ca9-7a97-42ca-b022-51abd2cee90d" returned: 0 in 0.288s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-44e62ca9-7a97-42ca-b022-51abd2cee90d" released by "delete_volume" :: held 0.716s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:17 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e 1G" returned: 0 in 0.415s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcfef17f-c800-43be-aa25-53ad3ea90254 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:17 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcfef17f-c800-43be-aa25-53ad3ea90254 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e Nov 06 21:57:17 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Created reservations ['d18efbd1-8546-4016-9dc5-bea743bc3884', 'be77ce0d-50b3-4408-bf48-77fb24259c91', '5c7e80f5-0b27-47c0-8d4f-63115d0ad42e', '772833f4-b97e-42ce-84f6-b229572178af'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:17 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:17 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-48ccf190-2e90-4dad-bb5c-894a3feeff2b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-48ccf190-2e90-4dad-bb5c-894a3feeff2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:17 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcfef17f-c800-43be-aa25-53ad3ea90254 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e" returned: 0 in 0.335s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:17 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e is being set with open permissions: ugo+rw Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-quobyte-48ccf190-2e90-4dad-bb5c-894a3feeff2b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:17 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e Nov 06 21:57:17 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-48ccf190-2e90-4dad-bb5c-894a3feeff2b" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:17 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.281s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5845b3bb-62bf-46b4-9123-d8c5ddfee480]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:17 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Deleted volume successfully. Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e6bcb378-b598-4460-b4b1-d02a8572afd9 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-44e62ca9-7a97-42ca-b022-51abd2cee90d-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:17 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b Nov 06 21:57:17 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:17 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e" returned: 0 in 0.264s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:18 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.info Nov 06 21:57:18 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:18 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b" returned: 0 in 0.387s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:18 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b Nov 06 21:57:18 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:18 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.info" returned: 0 in 0.266s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:18 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.info is being set with open permissions: ugo+rw Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:18 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.info Nov 06 21:57:18 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:18 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-48ccf190-2e90-4dad-bb5c-894a3feeff2b" returned: 0 in 0.255s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-48ccf190-2e90-4dad-bb5c-894a3feeff2b" released by "delete_volume" :: held 0.698s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Created reservations ['37b7f5ac-2e0d-4e94-9328-ba423016a01e', 'a27d1a07-4e16-4908-bdf5-8fc25d2c6c82', 'ad8bc4d0-513a-4fd7-9dbb-fb7bb3ee5b29', '1ec12653-6198-41d8-b7f8-90079e49854c'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:18 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.info" returned: 0 in 0.251s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.398s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-908688857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99949382-3042-46c7-8c20-29b4ee8ba6a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c5d03d7417422d9665fe09af587467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:12Z,use_quota=True,user_id='0a36ebab7e714561a0d2e3f6e671be9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Creating volume 99949382-3042-46c7-8c20-29b4ee8ba6a8 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:18 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:18 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 1073741824 Nov 06 21:57:18 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6324db73-7523-407c-aa16-239ad5166754 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Create snapshot completed successfully Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:18 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:18 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "cinder-quobyte-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346" acquired by "delete_volume" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:18 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.315s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Deleted volume successfully. Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[38947aac-c4fa-471c-9f09-d5009ee28282]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6e99fcd5-f9da-401e-81c5-c07f219b1682 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-48ccf190-2e90-4dad-bb5c-894a3feeff2b-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:19 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 1073741824" returned: 0 in 0.501s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:19 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 Nov 06 21:57:19 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:19 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 Nov 06 21:57:19 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:19 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346" returned: 0 in 0.383s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:19 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8" returned: 0 in 0.278s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:19 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346 Nov 06 21:57:19 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.055s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7366576e-7f21-4410-9fc4-98e9c6eab139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8f42708194e6f9f86230da9cd4f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:11Z,use_quota=True,user_id='78bb082837c648a7a5c3843ea585bd94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3b3827c-1e03-477c-882f-1becfe78d635),volume_type_id=c3b3827c-1e03-477c-882f-1becfe78d635)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Creating volume 7366576e-7f21-4410-9fc4-98e9c6eab139 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:19 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5b36d4-3e96-4021-a53a-64a701d4799c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99949382-3042-46c7-8c20-29b4ee8ba6a8', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df98b70f-8722-44f1-9ecd-53730d1f7d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:19 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 1073741824 Nov 06 21:57:19 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Volume volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 (99949382-3042-46c7-8c20-29b4ee8ba6a8): created successfully Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df98b70f-8722-44f1-9ecd-53730d1f7d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Flow 'volume_create_manager' (d7485222-91c4-4436-817c-944cd61103b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-782a0e28-8a51-4bbf-83e9-6678d05d561a tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created volume successfully. Nov 06 21:57:19 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346" returned: 0 in 0.344s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-quobyte-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346" released by "delete_volume" :: held 0.770s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-99949382-3042-46c7-8c20-29b4ee8ba6a8-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-99949382-3042-46c7-8c20-29b4ee8ba6a8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Created reservations ['882dc968-bdc4-4a95-9f90-43bb7e8db6f8', 'c4958ece-fb74-4f45-bfee-cf7543c51aa4', '6a6020db-2f7f-470f-a0f9-aeb3876be4e9', '9a9bbdcf-3843-49d2-a47b-7a45db2352e2'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-quobyte-99949382-3042-46c7-8c20-29b4ee8ba6a8" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (63c1e096-f5af-4ac4-a057-289dbe7d8ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bf5230-984f-48ba-8500-bd12461e4d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-99949382-3042-46c7-8c20-29b4ee8ba6a8" acquired by "delete_volume" :: waited 0.072s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66bf5230-984f-48ba-8500-bd12461e4d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1082594353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9d92d5-f333-42ca-b926-6079c5fc2032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:20Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:19 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475ccf96-fc50-4fa5-b3bc-bb74b9432c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475ccf96-fc50-4fa5-b3bc-bb74b9432c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6a3af0-656c-47c3-b795-477128144529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6a3af0-656c-47c3-b795-477128144529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9d92d5-f333-42ca-b926-6079c5fc2032', 'volume_name': 'volume-7d9d92d5-f333-42ca-b926-6079c5fc2032', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31ff753-66d9-4acb-ba82-d483b197f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31ff753-66d9-4acb-ba82-d483b197f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f917ddd6-0892-4035-9ed8-11b3780c5b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume 7d9d92d5-f333-42ca-b926-6079c5fc2032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9d92d5-f333-42ca-b926-6079c5fc2032', 'volume_size': 1} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:19 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8ea41a-fdac-4ca4-b43a-74c17cf17a13]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 1073741824" returned: 0 in 0.646s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:20 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:20 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:20 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 Nov 06 21:57:20 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:20 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 Nov 06 21:57:20 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:20 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.460s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:20 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (239fc6eb-5984-436e-8e8f-7faf619ecdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc69117-42d2-43b8-9e49-ca61da7c8c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Deleted volume successfully. Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8" returned: 0 in 0.578s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:20 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8 Nov 06 21:57:20 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc69117-42d2-43b8-9e49-ca61da7c8c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1731745526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6ce06e-268b-416b-87c1-dcc2fbb070d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:20Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:20 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f95c5d-80d4-4670-aab4-9f6f12ce9eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f95c5d-80d4-4670-aab4-9f6f12ce9eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace51437-ad1f-4d90-b859-c76378f85616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace51437-ad1f-4d90-b859-c76378f85616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6ce06e-268b-416b-87c1-dcc2fbb070d2', 'volume_name': 'volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0114d6-2d15-44a9-9a2f-6eac5924ac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0114d6-2d15-44a9-9a2f-6eac5924ac53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f560e4e-7edf-4ccf-b482-2087109bafb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:20 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume cb6ce06e-268b-416b-87c1-dcc2fbb070d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2', 'volume_size': 1} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139" returned: 0 in 0.623s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1082594353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9d92d5-f333-42ca-b926-6079c5fc2032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:20Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Creating volume 7d9d92d5-f333-42ca-b926-6079c5fc2032 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:20 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1338c695-9328-4ec6-98b7-94a003f3f5a0 tempest-CreateVolumesFromImageTest-793653821 None] Lock "cinder-0e1e7f6f-6cfd-4ca6-ac00-103c1957a346-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:20 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 1073741824 Nov 06 21:57:20 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Attempting download of 91647a62-59c0-40db-b90c-6b8334363717 ((None, [{'url': 'file:///opt/stack/data/glance/images/91647a62-59c0-40db-b90c-6b8334363717', 'metadata': {}}])) to volume 7366576e-7f21-4410-9fc4-98e9c6eab139. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[45945277-812d-49a0-8984-45cc6dbe0de6]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91647a62-59c0-40db-b90c-6b8334363717__96b9bzd {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:20 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-99949382-3042-46c7-8c20-29b4ee8ba6a8" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-99949382-3042-46c7-8c20-29b4ee8ba6a8" released by "delete_volume" :: held 1.109s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:21 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91647a62-59c0-40db-b90c-6b8334363717__96b9bzd Nov 06 21:57:21 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (b2adfe66-00e7-4426-a64b-63f84f8534fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf38d6d-6d76-4b38-b4a6-fcff98c5cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf38d6d-6d76-4b38-b4a6-fcff98c5cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1492988196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a843f-0996-4b7e-b943-7c5020e4aa17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:21Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5842da5-7af5-4ccd-b88c-630458f2264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5842da5-7af5-4ccd-b88c-630458f2264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b129a3d-f182-488a-921a-c5c31172b6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b129a3d-f182-488a-921a-c5c31172b6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5a843f-0996-4b7e-b943-7c5020e4aa17', 'volume_name': 'volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03e328c-601e-4023-b51f-06fcf71b9d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03e328c-601e-4023-b51f-06fcf71b9d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b807b45-bf81-4fae-9462-ade63f88d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:21 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume 4f5a843f-0996-4b7e-b943-7c5020e4aa17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17', 'volume_size': 1} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created reservations ['28e42e36-cbe1-489b-8eaf-557449dc826b', '6fb12970-eceb-464b-a1d9-8a02f2d3effc', '2ec6e301-143f-4103-af5c-b55275367c33', '5a6aaa9a-1c5e-471b-b414-e72459776c5a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:21 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 1073741824" returned: 0 in 0.785s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:21 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:21 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:21 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_91647a62-59c0-40db-b90c-6b8334363717__96b9bzd" returned: 0 in 0.652s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91647a62-59c0-40db-b90c-6b8334363717__96b9bzd {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:21 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 Nov 06 21:57:21 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:21 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91647a62-59c0-40db-b90c-6b8334363717__96b9bzd Nov 06 21:57:21 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (7700b1c0-d5a4-4d3f-9a0f-1ef756a5568f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacd7fd5-93c7-4512-bad4-0db52d40db77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bacd7fd5-93c7-4512-bad4-0db52d40db77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198130244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88346f55-6332-4918-8e1c-82c2d4c529e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:22Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:21 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f11ddfa-2a6d-4b7f-8774-537691167e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f11ddfa-2a6d-4b7f-8774-537691167e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48eb1ff7-c32c-470a-9044-4a7ddb9d3cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48eb1ff7-c32c-470a-9044-4a7ddb9d3cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88346f55-6332-4918-8e1c-82c2d4c529e6', 'volume_name': 'volume-88346f55-6332-4918-8e1c-82c2d4c529e6', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc39abac-6f21-4675-974a-fa1c2b3bd535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc39abac-6f21-4675-974a-fa1c2b3bd535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dce3bad-f30d-4781-a417-1ae081489e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume 88346f55-6332-4918-8e1c-82c2d4c529e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88346f55-6332-4918-8e1c-82c2d4c529e6', 'volume_size': 1} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.585s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Deleted volume successfully. Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9018a77d-b734-4275-b431-fad42cec024f tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-99949382-3042-46c7-8c20-29b4ee8ba6a8-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:22 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91647a62-59c0-40db-b90c-6b8334363717__96b9bzd" returned: 1 in 0.577s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_91647a62-59c0-40db-b90c-6b8334363717__96b9bzd' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdde801-273b-47ff-a2f4-6693c802a62a]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-b51948b4-19ce-45a4-bda5-2b9ff3b60566-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-b51948b4-19ce-45a4-bda5-2b9ff3b60566-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:22 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032" returned: 0 in 0.615s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1731745526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6ce06e-268b-416b-87c1-dcc2fbb070d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:20Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Creating volume cb6ce06e-268b-416b-87c1-dcc2fbb070d2 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:22 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:22 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD Nov 06 21:57:22 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:22 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 1073741824 Nov 06 21:57:22 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f917ddd6-0892-4035-9ed8-11b3780c5b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9d92d5-f333-42ca-b926-6079c5fc2032', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aedc496-d7ce-435b-9c11-b72d8ac70fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 (7d9d92d5-f333-42ca-b926-6079c5fc2032): created successfully Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aedc496-d7ce-435b-9c11-b72d8ac70fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (63c1e096-f5af-4ac4-a057-289dbe7d8ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (d11ba5c9-9517-441a-a4ef-5fea94edd9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6e16b5-16a1-4d03-b3d8-dc6fa57ab981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-quobyte-b51948b4-19ce-45a4-bda5-2b9ff3b60566" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b79b4674-ca1f-4ce8-bbd1-e30162f3f80d tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created volume successfully. Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6e16b5-16a1-4d03-b3d8-dc6fa57ab981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891952900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2878c3ca-71cc-41ba-a936-29616e33bd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:22Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cad030-41c3-44fb-9f57-4422a24bf2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13cad030-41c3-44fb-9f57-4422a24bf2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ecc8df-6644-4f79-b46d-d89789eb63c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ecc8df-6644-4f79-b46d-d89789eb63c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2878c3ca-71cc-41ba-a936-29616e33bd0b', 'volume_name': 'volume-2878c3ca-71cc-41ba-a936-29616e33bd0b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad1256-aef2-4d24-9061-3a75314b978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ad1256-aef2-4d24-9061-3a75314b978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cde3ca-500c-45fc-84a0-a3ca07780d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:22 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume 2878c3ca-71cc-41ba-a936-29616e33bd0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2878c3ca-71cc-41ba-a936-29616e33bd0b', 'volume_size': 1} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-b51948b4-19ce-45a4-bda5-2b9ff3b60566" acquired by "delete_volume" :: waited 0.070s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee6b415-fae0-4077-856c-4c90781f3d42]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:22 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:22 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 Nov 06 21:57:22 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:22 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD Nov 06 21:57:22 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:22 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 1073741824" returned: 0 in 0.586s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:22 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 Nov 06 21:57:22 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:22 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD" returned: 1 in 0.427s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] 91647a62-59c0-40db-b90c-6b8334363717 was raw, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:23 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566" returned: 0 in 0.487s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:23 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 Nov 06 21:57:23 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:23 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566 Nov 06 21:57:23 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:23 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2" returned: 0 in 0.323s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.937s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1492988196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5a843f-0996-4b7e-b943-7c5020e4aa17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:21Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Creating volume 4f5a843f-0996-4b7e-b943-7c5020e4aa17 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:23 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f560e4e-7edf-4ccf-b482-2087109bafb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:23 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 1073741824 Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25445f55-0bb7-4b41-8f12-f23343656a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:23 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:23 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 (cb6ce06e-268b-416b-87c1-dcc2fbb070d2): created successfully Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25445f55-0bb7-4b41-8f12-f23343656a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:23 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (239fc6eb-5984-436e-8e8f-7faf619ecdf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b51948b4-19ce-45a4-bda5-2b9ff3b60566" returned: 0 in 0.335s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-b51948b4-19ce-45a4-bda5-2b9ff3b60566" released by "delete_volume" :: held 0.898s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-deabcb1e-ab6a-4613-81d1-c754fa977951 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created volume successfully. Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created reservations ['3acabdc8-3a2b-4eee-be6d-d1c63d284075', '62243ac8-5b43-4360-8dac-30165c0efced', '16dfb967-db24-4ece-ae42-fc2bc8ed12e6', '9253a15f-e2bf-40d7-ba23-4e41a6e68cbe'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:23 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:23 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:23 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139" returned: 0 in 0.630s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_91647a62-59c0-40db-b90c-6b8334363717_mhw_pdtldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:57:23 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:23 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 1G Nov 06 21:57:23 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:23 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 1073741824" returned: 0 in 0.587s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:23 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.364s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Deleted volume successfully. Nov 06 21:57:23 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 Nov 06 21:57:23 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-281cd173-4e77-4d0b-99ff-912613bdb3bb tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-b51948b4-19ce-45a4-bda5-2b9ff3b60566-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:24 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 1G" returned: 0 in 0.377s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Downloaded image 91647a62-59c0-40db-b90c-6b8334363717 ((None, [{'url': 'file:///opt/stack/data/glance/images/91647a62-59c0-40db-b90c-6b8334363717', 'metadata': {}}])) to volume 7366576e-7f21-4410-9fc4-98e9c6eab139 successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Temporary image 91647a62-59c0-40db-b90c-6b8334363717 for user 78bb082837c648a7a5c3843ea585bd94 is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Marking volume 7366576e-7f21-4410-9fc4-98e9c6eab139 as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Copying metadata from image 91647a62-59c0-40db-b90c-6b8334363717 to 7366576e-7f21-4410-9fc4-98e9c6eab139. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Creating volume glance metadata for volume 7366576e-7f21-4410-9fc4-98e9c6eab139 backed by image 91647a62-59c0-40db-b90c-6b8334363717 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '91647a62-59c0-40db-b90c-6b8334363717', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e50cbf99c240e3ee135cdb0daab06a12', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ab1975-5c20-44ca-abd9-37fa0090ab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7366576e-7f21-4410-9fc4-98e9c6eab139', 'volume_size': 1, 'image_id': '91647a62-59c0-40db-b90c-6b8334363717', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/91647a62-59c0-40db-b90c-6b8334363717', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e50cbf99c240e3ee135cdb0daab06a12', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43f8f42708194e6f9f86230da9cd4f0d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ca055828ff611e44eafc662f7110170986b731f50ca80f927c66051edc64cf9aa9066697498d237b91fcb82a4a4e4959ae4210616a845685414f0c31ad0d89b', 'id': '91647a62-59c0-40db-b90c-6b8334363717', 'created_at': datetime.datetime(2026, 11, 6, 20, 57, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 57, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/91647a62-59c0-40db-b90c-6b8334363717/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c154da8-f4f4-4e7a-95e9-c9c767159277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:24 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Volume volume-7366576e-7f21-4410-9fc4-98e9c6eab139 (7366576e-7f21-4410-9fc4-98e9c6eab139): created successfully Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c154da8-f4f4-4e7a-95e9-c9c767159277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Flow 'volume_create_manager' (9487921d-e2bb-46ed-9a3d-6d88bca611a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2f66d361-9c75-40f2-9b8b-7a99509eff36 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Created volume successfully. Nov 06 21:57:24 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17" returned: 0 in 0.294s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.124s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1198130244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88346f55-6332-4918-8e1c-82c2d4c529e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:22Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Creating volume 88346f55-6332-4918-8e1c-82c2d4c529e6 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:24 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b807b45-bf81-4fae-9462-ade63f88d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29627193-8006-409c-9b56-1217bc241cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:24 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 1073741824 Nov 06 21:57:24 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:24 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 (4f5a843f-0996-4b7e-b943-7c5020e4aa17): created successfully Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29627193-8006-409c-9b56-1217bc241cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (b2adfe66-00e7-4426-a64b-63f84f8534fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d029d7a9-bc25-46a9-b77e-0c5d2d00abaf tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created volume successfully. Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Flow 'volume_create_manager' (72aa6a42-474b-4e1a-8bfe-ef744102b88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a35300a-25d1-4e3b-8e52-3a0d2b3c6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a35300a-25d1-4e3b-8e52-3a0d2b3c6d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1483871243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d97235-5c06-4b2f-9b51-576be1555d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecec3801f72d4aed8844fc26ed267fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:24Z,use_quota=True,user_id='a62cda13533549afb2d82d417440cac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef355a5-9c57-4966-bf3c-7b373f06167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef355a5-9c57-4966-bf3c-7b373f06167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08202b91-bf6f-4311-b32c-45de1f87ef59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08202b91-bf6f-4311-b32c-45de1f87ef59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d97235-5c06-4b2f-9b51-576be1555d14', 'volume_name': 'volume-b1d97235-5c06-4b2f-9b51-576be1555d14', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f611e805-b473-489d-96af-218348e8b9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f611e805-b473-489d-96af-218348e8b9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9d7e50-ee89-434e-9ca8-af8d23a68b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:24 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Volume b1d97235-5c06-4b2f-9b51-576be1555d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d97235-5c06-4b2f-9b51-576be1555d14', 'volume_size': 1} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-d08c8366-358a-4c74-a546-82dc46b12c47-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-d08c8366-358a-4c74-a546-82dc46b12c47-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-quobyte-d08c8366-358a-4c74-a546-82dc46b12c47" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-d08c8366-358a-4c74-a546-82dc46b12c47" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[36148c48-1ff4-4b04-a553-ba5de7324ca0]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:24 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 1073741824" returned: 0 in 0.496s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:24 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 Nov 06 21:57:24 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:24 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 Nov 06 21:57:24 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Acquiring lock "cinder-7366576e-7f21-4410-9fc4-98e9c6eab139-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "cinder-7366576e-7f21-4410-9fc4-98e9c6eab139-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:25 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:25 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6" returned: 0 in 0.272s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.541s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-891952900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2878c3ca-71cc-41ba-a936-29616e33bd0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='825a02c174a4430f85e8ed73bcc7c071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:22Z,use_quota=True,user_id='3171ac871991492f9323ccf15c740aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Creating volume 2878c3ca-71cc-41ba-a936-29616e33bd0b {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:25 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Acquiring lock "cinder-quobyte-7366576e-7f21-4410-9fc4-98e9c6eab139" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47" returned: 0 in 0.420s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:25 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b 1073741824 Nov 06 21:57:25 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dce3bad-f30d-4781-a417-1ae081489e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88346f55-6332-4918-8e1c-82c2d4c529e6', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cbe8b8-46a9-47fd-96aa-59e461d1659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:25 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47 Nov 06 21:57:25 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "cinder-quobyte-7366576e-7f21-4410-9fc4-98e9c6eab139" acquired by "delete_volume" :: waited 0.047s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:25 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume volume-88346f55-6332-4918-8e1c-82c2d4c529e6 (88346f55-6332-4918-8e1c-82c2d4c529e6): created successfully Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cbe8b8-46a9-47fd-96aa-59e461d1659a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (7700b1c0-d5a4-4d3f-9a0f-1ef756a5568f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a049f209-8515-4cab-9540-a0502edba60c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-5ea490e9-3176-47c1-960d-cd422d21dcfc tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created volume successfully. Nov 06 21:57:25 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 Nov 06 21:57:25 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:25 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d08c8366-358a-4c74-a546-82dc46b12c47" returned: 0 in 0.273s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-d08c8366-358a-4c74-a546-82dc46b12c47" released by "delete_volume" :: held 0.738s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created reservations ['2dc40efa-1d7b-4eec-b0b8-a0f6cd53b7d5', '91dcf398-7f64-442d-b367-93aadc6973b3', 'ea2596de-e020-4287-b5ef-78cb123ecf0e', '8675f798-5e2d-4e3c-8753-9a796424a654'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:25 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:25 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:25 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b 1073741824" returned: 0 in 0.497s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:25 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139" returned: 0 in 0.408s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:25 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139 Nov 06 21:57:25 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:25 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b Nov 06 21:57:25 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-209334c3-7c80-4913-aaa7-2b971082fcb7-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-209334c3-7c80-4913-aaa7-2b971082fcb7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:25 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.309s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Deleted volume successfully. Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c2a97747-9241-4671-b03a-d42157854a27 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-d08c8366-358a-4c74-a546-82dc46b12c47-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-quobyte-209334c3-7c80-4913-aaa7-2b971082fcb7" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-209334c3-7c80-4913-aaa7-2b971082fcb7" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1857bd67-fd51-4e19-a361-f03ccee95d8b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:25 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7366576e-7f21-4410-9fc4-98e9c6eab139" returned: 0 in 0.338s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "cinder-quobyte-7366576e-7f21-4410-9fc4-98e9c6eab139" released by "delete_volume" :: held 0.812s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:25 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b" returned: 0 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1483871243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d97235-5c06-4b2f-9b51-576be1555d14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecec3801f72d4aed8844fc26ed267fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:24Z,use_quota=True,user_id='a62cda13533549afb2d82d417440cac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Creating volume b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:25 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Created reservations ['43abac9c-5272-4616-84e6-96d069ebccf0', 'a52f48f4-c18f-46f3-99ba-375bcccb86c9', '4b7101ab-2b87-465c-8158-23a4fa757146', '3e2fc0ab-790b-48d0-8477-0ea54666c443'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:25 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cde3ca-500c-45fc-84a0-a3ca07780d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2878c3ca-71cc-41ba-a936-29616e33bd0b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:25 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:25 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 1073741824 Nov 06 21:57:25 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:25 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ae6aaf-0a0a-4f86-b524-a33d8af918fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:26 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Volume volume-2878c3ca-71cc-41ba-a936-29616e33bd0b (2878c3ca-71cc-41ba-a936-29616e33bd0b): created successfully Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ae6aaf-0a0a-4f86-b524-a33d8af918fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Flow 'volume_create_manager' (d11ba5c9-9517-441a-a4ef-5fea94edd9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cd356c73-e27c-45fc-9a8b-9111e17621c3 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created volume successfully. Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:26 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:26 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:26 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7" returned: 0 in 0.422s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:26 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7 Nov 06 21:57:26 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:26 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:26 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Deleted volume successfully. Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-104390a8-4590-4ea9-a1b8-9a2c03e272a5 tempest-VolumeAndVolumeTypeFromImageTest-1972480338 None] Lock "cinder-7366576e-7f21-4410-9fc4-98e9c6eab139-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:26 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 1073741824" returned: 0 in 0.577s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:26 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-209334c3-7c80-4913-aaa7-2b971082fcb7" returned: 0 in 0.292s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:26 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-209334c3-7c80-4913-aaa7-2b971082fcb7" released by "delete_volume" :: held 0.766s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created reservations ['4150218b-a1c2-4f1a-849a-0acbe3fdeb95', 'ac18d98c-4124-4738-a64e-f594224ef8fe', 'ec9c96b3-6784-44f1-b2b4-41da3be7ccd9', 'b7ad3aa4-88af-4f62-b1c1-0c621dfd8941'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:26 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:26 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:26 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:26 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14" returned: 0 in 0.299s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9d7e50-ee89-434e-9ca8-af8d23a68b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d97235-5c06-4b2f-9b51-576be1555d14', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c70128c-66ea-4fbe-8e7d-7dbafda533f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:26 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Volume volume-b1d97235-5c06-4b2f-9b51-576be1555d14 (b1d97235-5c06-4b2f-9b51-576be1555d14): created successfully Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c70128c-66ea-4fbe-8e7d-7dbafda533f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Flow 'volume_create_manager' (72aa6a42-474b-4e1a-8bfe-ef744102b88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:26 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-2878c3ca-71cc-41ba-a936-29616e33bd0b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-1dbfda3f-e44c-418b-b636-67f9265f74b9-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:27 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-766608da-5c8d-4d99-93e7-addd84f09682 tempest-VolumeDependencyTests-2002005880 None] Created volume successfully. Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-1dbfda3f-e44c-418b-b636-67f9265f74b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-2878c3ca-71cc-41ba-a936-29616e33bd0b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-quobyte-1dbfda3f-e44c-418b-b636-67f9265f74b9" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-quobyte-2878c3ca-71cc-41ba-a936-29616e33bd0b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-1dbfda3f-e44c-418b-b636-67f9265f74b9" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-2878c3ca-71cc-41ba-a936-29616e33bd0b" acquired by "delete_volume" :: waited 0.052s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cce9080-9f5e-4919-8598-a73767a5f0d2]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d1fdee-4d2c-4d69-8cff-283b0c94356c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:27 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.472s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:27 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Deleted volume successfully. Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bd456009-6ca1-40e9-a34d-1efebc9f5afd tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-209334c3-7c80-4913-aaa7-2b971082fcb7-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:27 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b Nov 06 21:57:27 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:27 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 Nov 06 21:57:27 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:27 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b" returned: 0 in 0.467s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:27 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9" returned: 0 in 0.519s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:27 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b Nov 06 21:57:27 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:27 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9 Nov 06 21:57:27 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Creating offline snapshot 21ad8fca-c0e8-4fb0-8daf-364c21a77e8f of volume b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c66c2a-09bb-43d7-9d7c-ef5f25e2dfcd]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:28 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1dbfda3f-e44c-418b-b636-67f9265f74b9" returned: 0 in 0.368s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-1dbfda3f-e44c-418b-b636-67f9265f74b9" released by "delete_volume" :: held 0.990s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:28 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-2878c3ca-71cc-41ba-a936-29616e33bd0b" returned: 0 in 0.455s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-2878c3ca-71cc-41ba-a936-29616e33bd0b" released by "delete_volume" :: held 1.016s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created reservations ['53f13726-64b6-4645-8719-83e01bf1d543', '5515b9db-27e7-44ad-a2cc-40e707cef81a', 'cc702097-85d5-403d-8dd9-ffbb87d384e4', 'b543f1af-f178-4d56-947a-d6996e703f1a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:28 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 Nov 06 21:57:28 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created reservations ['54587718-f0d5-4b58-a7b4-6db0184f65c6', '0acc36a6-aed0-4907-bf5d-2b39acbf1772', 'ecb9ab4b-12cc-473f-ba33-00bfbdec703b', 'bae522c5-ddeb-49a0-aa79-a02d147f3c79'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:28 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:28 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:28 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:28 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:28 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14" returned: 0 in 0.507s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:28 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f 1G Nov 06 21:57:28 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:28 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.315s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Deleted volume successfully. Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0dad34f-ec09-422e-8384-78a6e7396df2 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-1dbfda3f-e44c-418b-b636-67f9265f74b9-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:28 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.354s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:28 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Deleted volume successfully. Nov 06 21:57:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b3019114-d663-433a-b421-335997095a4c tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-2878c3ca-71cc-41ba-a936-29616e33bd0b-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:29 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f 1G" returned: 0 in 0.469s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d97235-5c06-4b2f-9b51-576be1555d14 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:29 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d97235-5c06-4b2f-9b51-576be1555d14 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f Nov 06 21:57:29 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-3645c694-9518-41ef-9102-c1d1faa928c0-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-88346f55-6332-4918-8e1c-82c2d4c529e6-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-3645c694-9518-41ef-9102-c1d1faa928c0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-88346f55-6332-4918-8e1c-82c2d4c529e6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-quobyte-88346f55-6332-4918-8e1c-82c2d4c529e6" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:29 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d97235-5c06-4b2f-9b51-576be1555d14 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" returned: 0 in 0.392s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:29 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f is being set with open permissions: ugo+rw Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "cinder-quobyte-3645c694-9518-41ef-9102-c1d1faa928c0" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:29 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f Nov 06 21:57:29 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-88346f55-6332-4918-8e1c-82c2d4c529e6" acquired by "delete_volume" :: waited 0.042s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-3645c694-9518-41ef-9102-c1d1faa928c0" acquired by "delete_volume" :: waited 0.039s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26d5541-4762-4e75-8397-23f07049ab49]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc56b645-637f-4d2b-8ec3-b329ce3426ef]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:29 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 Nov 06 21:57:29 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:29 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 Nov 06 21:57:29 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:29 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" returned: 0 in 0.309s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:29 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.info Nov 06 21:57:29 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:29 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6" returned: 0 in 0.413s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:29 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6 Nov 06 21:57:29 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:29 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0" returned: 0 in 0.477s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:30 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0 Nov 06 21:57:30 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:30 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.info" returned: 0 in 0.395s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:30 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.info is being set with open permissions: ugo+rw Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:30 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.info Nov 06 21:57:30 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:30 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-88346f55-6332-4918-8e1c-82c2d4c529e6" returned: 0 in 0.318s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-88346f55-6332-4918-8e1c-82c2d4c529e6" released by "delete_volume" :: held 0.797s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created reservations ['b1b03146-80b8-4fcc-9e99-6434d85f64ab', '68a93dd5-4094-4574-a729-8e63e4316ab2', 'ca051542-4c74-42de-99e5-5070bcaa9b73', 'f1fec9c1-5a73-421d-b958-c30a7b329add'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:30 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-4f5a843f-0996-4b7e-b943-7c5020e4aa17-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:30 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3645c694-9518-41ef-9102-c1d1faa928c0" returned: 0 in 0.580s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:30 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:30 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.info" returned: 0 in 0.417s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-quobyte-3645c694-9518-41ef-9102-c1d1faa928c0" released by "delete_volume" :: held 1.160s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-4f5a843f-0996-4b7e-b943-7c5020e4aa17-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-36f03d15-c2f3-4fe8-983b-c59de5b7dacc tempest-VolumeDependencyTests-2002005880 None] Create snapshot completed successfully Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-quobyte-4f5a843f-0996-4b7e-b943-7c5020e4aa17" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-4f5a843f-0996-4b7e-b943-7c5020e4aa17" acquired by "delete_volume" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Created reservations ['0c4bc639-415e-4443-aace-e564ca26fd44', '3bf1116c-c29d-4a30-82fc-303025040737', 'f1300ddd-1404-4179-9cfc-9cc332f7e9ed', '8bdc9446-2fb8-4c8e-ad13-ff56c5016454'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[545e7242-bb46-429a-930e-fc488cd0836b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:30 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.370s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Deleted volume successfully. Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:30 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 Nov 06 21:57:30 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d0d8c827-ac05-4563-a475-7dcd850d6c0b tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-88346f55-6332-4918-8e1c-82c2d4c529e6-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:30 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:30 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:31 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.293s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:31 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Deleted volume successfully. Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-498166d6-e41a-4737-adcd-ffc89c4ab108 tempest-CreateVolumesFromSourceVolumeTest-1852056382 None] Lock "cinder-3645c694-9518-41ef-9102-c1d1faa928c0-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:31 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17" returned: 0 in 0.495s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:31 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17 Nov 06 21:57:31 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:31 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-4f5a843f-0996-4b7e-b943-7c5020e4aa17" returned: 0 in 0.341s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-4f5a843f-0996-4b7e-b943-7c5020e4aa17" released by "delete_volume" :: held 0.908s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created reservations ['ac95522d-f9dd-43a0-8951-c9e179ac7f01', '4c31bd43-7f99-4a68-8c5f-8404aa6e5a47', '7abbf03a-59a3-4fdb-84ec-2a4f0f0bf5a0', '8604aaaf-0303-46d4-9eb5-df54be98c7f6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:31 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:31 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Flow 'volume_create_manager' (ed4d7d1b-3ce4-4298-ba97-b6bfc62a36c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da641a84-9d03-45e4-8f82-91e80ce5e158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da641a84-9d03-45e4-8f82-91e80ce5e158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2121721566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40236e26-39f5-4f0c-8a27-64d40c6f1078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecec3801f72d4aed8844fc26ed267fc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=21ad8fca-c0e8-4fb0-8daf-364c21a77e8f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:32Z,use_quota=True,user_id='a62cda13533549afb2d82d417440cac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ad1e42-cc60-4725-b975-f91cb96a78d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ad1e42-cc60-4725-b975-f91cb96a78d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ad6bc7-eca8-48d7-b7fb-dcb3ec3b82dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ad6bc7-eca8-48d7-b7fb-dcb3ec3b82dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40236e26-39f5-4f0c-8a27-64d40c6f1078', 'volume_name': 'volume-40236e26-39f5-4f0c-8a27-64d40c6f1078', 'volume_size': 1, 'snapshot_id': '21ad8fca-c0e8-4fb0-8daf-364c21a77e8f'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc23c99-04ea-4546-ba3b-e77288a5c9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc23c99-04ea-4546-ba3b-e77288a5c9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a9c81d-fbd1-4265-98ca-3ac462dd2453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:31 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Volume 40236e26-39f5-4f0c-8a27-64d40c6f1078: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40236e26-39f5-4f0c-8a27-64d40c6f1078', 'volume_size': 1, 'snapshot_id': '21ad8fca-c0e8-4fb0-8daf-364c21a77e8f'} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-quobyte-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f-40236e26-39f5-4f0c-8a27-64d40c6f1078" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f-40236e26-39f5-4f0c-8a27-64d40c6f1078" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Creating volume 40236e26-39f5-4f0c-8a27-64d40c6f1078 from snapshot 21ad8fca-c0e8-4fb0-8daf-364c21a77e8f {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-quobyte-40236e26-39f5-4f0c-8a27-64d40c6f1078" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-40236e26-39f5-4f0c-8a27-64d40c6f1078" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] snapshot: 21ad8fca-c0e8-4fb0-8daf-364c21a77e8f, volume: 40236e26-39f5-4f0c-8a27-64d40c6f1078, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cde0d97-2eeb-414b-b059-0ac02c0f3b12]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:32 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.300s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Deleted volume successfully. Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-29115fdd-f80b-4452-90f4-2cfeda375233 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-4f5a843f-0996-4b7e-b943-7c5020e4aa17-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:32 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f Nov 06 21:57:32 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:32 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" returned: 0 in 0.405s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d97235-5c06-4b2f-9b51-576be1555d14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[39edc439-4eac-4de7-98eb-19c8784f63ee]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d84f1e9a-d0c5-4120-9d9f-bd9adae60db1 tempest-ProjectAdminTests-215863730 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7199096679688, 'free_capacity_gb': 1773.7199096679688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87069) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 21:57:32 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 Nov 06 21:57:32 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-cb6ce06e-268b-416b-87c1-dcc2fbb070d2-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-cb6ce06e-268b-416b-87c1-dcc2fbb070d2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-quobyte-cb6ce06e-268b-416b-87c1-dcc2fbb070d2" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-cb6ce06e-268b-416b-87c1-dcc2fbb070d2" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7427bbd4-aebb-4a7e-b54c-3e793372b93b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:33 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14" returned: 0 in 0.570s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:33 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 Nov 06 21:57:33 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:33 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 Nov 06 21:57:33 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:33 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2" returned: 0 in 0.477s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:33 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2 Nov 06 21:57:33 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:33 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-cb6ce06e-268b-416b-87c1-dcc2fbb070d2" returned: 0 in 0.398s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-cb6ce06e-268b-416b-87c1-dcc2fbb070d2" released by "delete_volume" :: held 0.964s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created reservations ['dd0b1623-045b-46e4-859a-82d0331006a0', '74ad2afb-523f-400d-8553-6caf4b184850', 'a0df2c0f-7e60-4d5a-8ad1-d3a47c2c7cfa', 'bafade62-6e74-4987-996f-028cec72e972'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:34 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:34 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:34 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.360s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:34 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Deleted volume successfully. Nov 06 21:57:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-14797a22-9791-470c-ab21-0d2f19ace10e tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-cb6ce06e-268b-416b-87c1-dcc2fbb070d2-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-7d9d92d5-f333-42ca-b926-6079c5fc2032-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-7d9d92d5-f333-42ca-b926-6079c5fc2032-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-quobyte-7d9d92d5-f333-42ca-b926-6079c5fc2032" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:35 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-7d9d92d5-f333-42ca-b926-6079c5fc2032" acquired by "delete_volume" :: waited 0.060s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:35 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[34768f5b-1dd6-4e55-9649-a07a88023d8b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:35 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 Nov 06 21:57:35 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:36 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032" returned: 0 in 1.005s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:36 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032 Nov 06 21:57:36 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:36 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7d9d92d5-f333-42ca-b926-6079c5fc2032" returned: 0 in 0.362s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-7d9d92d5-f333-42ca-b926-6079c5fc2032" released by "delete_volume" :: held 1.473s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created reservations ['71f6b07a-b988-463c-bfd1-5d67eed13200', 'a8635f5c-f822-4c62-b773-22c5db17ba57', '9867ed9e-bf0e-4c50-b937-a86cad27dd7a', 'b7c2cd24-b169-457f-9199-0b2dad94c52b'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:37 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:37 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Flow 'volume_create_manager' (4a9fcdd0-663e-44ad-accf-58bd2d50fa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce78a16-c02d-47b3-8c1d-2a9d02f6b53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce78a16-c02d-47b3-8c1d-2a9d02f6b53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330e0c9f-8488-4f62-9423-7ae2ffd2c1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca96d9bb795546409565bbdabf5cd02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:37Z,use_quota=True,user_id='25f2bd17ea2440c6a787a39443f2d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc80fea1-8f3a-4332-b102-2d383ca579e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc80fea1-8f3a-4332-b102-2d383ca579e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7280a2b6-fed9-4195-b774-3e61b063d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7280a2b6-fed9-4195-b774-3e61b063d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330e0c9f-8488-4f62-9423-7ae2ffd2c1ba', 'volume_name': 'volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16a6a05-ea16-4812-aa87-bec7c470dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16a6a05-ea16-4812-aa87-bec7c470dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a3a6c6-8a28-48ba-8393-b3063c75cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:37 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Volume 330e0c9f-8488-4f62-9423-7ae2ffd2c1ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba', 'volume_size': 1} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:37 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-391686de-bee6-4e29-a364-2d0eecb35f5e-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.588s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:37 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Deleted volume successfully. Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-391686de-bee6-4e29-a364-2d0eecb35f5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-quobyte-bcfef17f-c800-43be-aa25-53ad3ea90254" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-08a74c98-76bd-48f8-882f-bdbb7331125a tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-7d9d92d5-f333-42ca-b926-6079c5fc2032-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-bcfef17f-c800-43be-aa25-53ad3ea90254" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:37 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-quobyte-391686de-bee6-4e29-a364-2d0eecb35f5e" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-391686de-bee6-4e29-a364-2d0eecb35f5e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Deleting offline snapshot 391686de-bee6-4e29-a364-2d0eecb35f5e of volume bcfef17f-c800-43be-aa25-53ad3ea90254 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] snapshot_file for this snap is: volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de1304-e059-43e3-b2c6-32aa4f0010df]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:38 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e Nov 06 21:57:38 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:38 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e" returned: 0 in 0.598s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcfef17f-c800-43be-aa25-53ad3ea90254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5336da-133a-4e80-96f8-00a4749b04aa]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:38 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 Nov 06 21:57:38 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:39 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254" returned: 0 in 0.664s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:39 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e Nov 06 21:57:39 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:40 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e" returned: 0 in 0.691s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:40 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e Nov 06 21:57:40 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:40 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254.391686de-bee6-4e29-a364-2d0eecb35f5e" returned: 0 in 0.428s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-391686de-bee6-4e29-a364-2d0eecb35f5e" released by "_delete_snapshot" :: held 2.679s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-bcfef17f-c800-43be-aa25-53ad3ea90254" released by "delete_snapshot" :: held 2.729s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:40 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created reservations ['248c171d-654c-4eec-9d2f-0674ea485b05', 'a8f00639-046b-4843-8b1b-f078fab8760a', '23a1e169-74ae-4167-8716-e7c0970b21e7', '40c54dbe-d7a2-47a1-b818-ad9d7f5b668f'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:41 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Delete snapshot completed successfully. Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36d7b1b2-3deb-4445-97ed-a7410f5c5aa8 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-391686de-bee6-4e29-a364-2d0eecb35f5e-delete_snapshot" released by "delete_snapshot" :: held 3.136s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-bcfef17f-c800-43be-aa25-53ad3ea90254-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-bcfef17f-c800-43be-aa25-53ad3ea90254-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "cinder-quobyte-bcfef17f-c800-43be-aa25-53ad3ea90254" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-bcfef17f-c800-43be-aa25-53ad3ea90254" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb5145-44ad-44ae-8bf1-a0ea2bcb524d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:41 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078" returned: 0 in 8.537s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14, size 1024.00 MB, duration 8.54 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:57:41 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Converted 1024.00 MB image at 119.94 MB/s Nov 06 21:57:41 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 is being set with open permissions: ugo+rw Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:41 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 Nov 06 21:57:41 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:41 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 Nov 06 21:57:41 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:41 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078" returned: 0 in 0.271s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-40236e26-39f5-4f0c-8a27-64d40c6f1078" released by "_copy_volume_from_snapshot" :: held 9.895s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:41 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254" returned: 0 in 0.447s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f-40236e26-39f5-4f0c-8a27-64d40c6f1078" released by "_create_volume_from_snapshot" :: held 9.984s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.296s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:42 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254 Nov 06 21:57:42 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330e0c9f-8488-4f62-9423-7ae2ffd2c1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca96d9bb795546409565bbdabf5cd02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:37Z,use_quota=True,user_id='25f2bd17ea2440c6a787a39443f2d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Creating volume 330e0c9f-8488-4f62-9423-7ae2ffd2c1ba {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:42 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:42 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba 1073741824 Nov 06 21:57:42 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a9c81d-fbd1-4265-98ca-3ac462dd2453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40236e26-39f5-4f0c-8a27-64d40c6f1078', 'volume_size': 1, 'snapshot_id': '21ad8fca-c0e8-4fb0-8daf-364c21a77e8f'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8ae8ab-1089-4a6a-a804-025b538e47b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:42 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Volume volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 (40236e26-39f5-4f0c-8a27-64d40c6f1078): created successfully Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8ae8ab-1089-4a6a-a804-025b538e47b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Flow 'volume_create_manager' (ed4d7d1b-3ce4-4298-ba97-b6bfc62a36c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:42 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-62867191-6e93-458d-928b-8f82c41dee9c tempest-VolumeDependencyTests-2002005880 None] Created volume successfully. Nov 06 21:57:42 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bcfef17f-c800-43be-aa25-53ad3ea90254" returned: 0 in 0.282s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-quobyte-bcfef17f-c800-43be-aa25-53ad3ea90254" released by "delete_volume" :: held 0.856s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Created reservations ['76e55b74-49d5-4856-aeea-aa7b45540cb4', '63a24d99-e7df-4924-8851-b4ecbf573d0e', 'a470eeaa-f9d1-468e-8b17-470da610dee9', '7fc55ad1-aa1d-4320-bf7a-f5ab3b9c335a'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:42 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:42 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:42 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba 1073741824" returned: 0 in 0.528s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:42 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba Nov 06 21:57:42 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:42 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.301s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:42 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Deleted volume successfully. Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1aae93ca-e036-4220-87d6-2cf32e619941 tempest-CreateVolumesFromSnapshotTest-1936303548 None] Lock "cinder-bcfef17f-c800-43be-aa25-53ad3ea90254-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:42 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba" returned: 0 in 0.342s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69a3a6c6-8a28-48ba-8393-b3063c75cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c928c0-db52-4c1f-9747-44423cb75513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:42 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Volume volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba (330e0c9f-8488-4f62-9423-7ae2ffd2c1ba): created successfully Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c928c0-db52-4c1f-9747-44423cb75513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:42 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Flow 'volume_create_manager' (4a9fcdd0-663e-44ad-accf-58bd2d50fa7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ed0ba024-f503-4327-8792-363f011e71fb tempest-CinderUnicodeTest-1922535591 None] Created volume successfully. Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-quobyte-b1d97235-5c06-4b2f-9b51-576be1555d14" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-b1d97235-5c06-4b2f-9b51-576be1555d14" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-quobyte-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Deleting offline snapshot 21ad8fca-c0e8-4fb0-8daf-364c21a77e8f of volume b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] snapshot_file for this snap is: volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4213cf0-cd14-4871-835b-543889f9825e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:43 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f Nov 06 21:57:43 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:43 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" returned: 0 in 0.493s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d97235-5c06-4b2f-9b51-576be1555d14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca9af6d-8e1f-48cb-9074-baad5cd5d305]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:43 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 Nov 06 21:57:43 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:44 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14" returned: 0 in 0.681s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:44 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f Nov 06 21:57:44 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Flow 'volume_create_manager' (b8b18eff-df68-4ff2-bc8c-e1df7600bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682c5469-27d4-47db-9f0f-497eddfd7596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (682c5469-27d4-47db-9f0f-497eddfd7596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-240506878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9990a551-7301-4acd-a680-ef7350a02524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca96d9bb795546409565bbdabf5cd02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:44Z,use_quota=True,user_id='25f2bd17ea2440c6a787a39443f2d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663dd535-27da-4766-af33-91f2b3fceb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663dd535-27da-4766-af33-91f2b3fceb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfed4720-f9e0-438a-8206-e7fa6dc0e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfed4720-f9e0-438a-8206-e7fa6dc0e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9990a551-7301-4acd-a680-ef7350a02524', 'volume_name': 'volume-9990a551-7301-4acd-a680-ef7350a02524', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca823d-dde4-434e-be52-21da33fd6445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca823d-dde4-434e-be52-21da33fd6445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed3b6ab-5bf4-4a8c-9221-e7f55c028f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:44 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Volume 9990a551-7301-4acd-a680-ef7350a02524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9990a551-7301-4acd-a680-ef7350a02524', 'volume_size': 1} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-240506878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9990a551-7301-4acd-a680-ef7350a02524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca96d9bb795546409565bbdabf5cd02e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:44Z,use_quota=True,user_id='25f2bd17ea2440c6a787a39443f2d0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Creating volume 9990a551-7301-4acd-a680-ef7350a02524 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:44 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:44 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 1073741824 Nov 06 21:57:44 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:44 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" returned: 0 in 0.459s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:44 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f Nov 06 21:57:44 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:45 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14.21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" returned: 0 in 0.282s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f" released by "_delete_snapshot" :: held 2.065s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-b1d97235-5c06-4b2f-9b51-576be1555d14" released by "delete_snapshot" :: held 2.096s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Created reservations ['69503f3f-8425-4670-9ee1-6283c2236b28', '42b1e037-356e-494a-a09b-6b56ac191953', '46af6dae-7acd-43e3-a0ce-7a0ace0a43b1', '7c67032c-0546-4307-aca6-d73deef395b0'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:45 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Delete snapshot completed successfully. Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-2aebf2f5-0f4f-4338-8dba-33c9683ff3dc tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-21ad8fca-c0e8-4fb0-8daf-364c21a77e8f-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:45 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 1073741824" returned: 0 in 0.644s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:45 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 Nov 06 21:57:45 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:45 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524" returned: 0 in 0.280s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed3b6ab-5bf4-4a8c-9221-e7f55c028f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9990a551-7301-4acd-a680-ef7350a02524', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5a69f9-641c-4c51-b920-f33812c631ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:45 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Volume volume-9990a551-7301-4acd-a680-ef7350a02524 (9990a551-7301-4acd-a680-ef7350a02524): created successfully Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5a69f9-641c-4c51-b920-f33812c631ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Flow 'volume_create_manager' (b8b18eff-df68-4ff2-bc8c-e1df7600bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:45 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-474bd758-01c9-4f49-8af5-8540d8559527 tempest-CinderUnicodeTest-1922535591 None] Created volume successfully. Nov 06 21:57:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-b1d97235-5c06-4b2f-9b51-576be1555d14-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-b1d97235-5c06-4b2f-9b51-576be1555d14-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-quobyte-b1d97235-5c06-4b2f-9b51-576be1555d14" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-b1d97235-5c06-4b2f-9b51-576be1555d14" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:46 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5602140b-b787-4485-bcba-05e23c24b5c2]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:46 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 Nov 06 21:57:46 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:46 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14" returned: 0 in 0.418s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:47 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14 Nov 06 21:57:47 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (b77564c4-56f5-4707-aa0e-a6cb87b24b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e139ed-a1f8-4697-85f8-85e87ffbec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e139ed-a1f8-4697-85f8-85e87ffbec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159252318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e43456-e975-42c8-90bf-ae37bd972345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:47Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c684de08-dd8a-45ee-a543-0d2aae412ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c684de08-dd8a-45ee-a543-0d2aae412ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05547a48-044e-49ab-934e-03a11ca20ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05547a48-044e-49ab-934e-03a11ca20ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2e43456-e975-42c8-90bf-ae37bd972345', 'volume_name': 'volume-d2e43456-e975-42c8-90bf-ae37bd972345', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e54309-fd29-4a4b-bd76-2738a9923a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e54309-fd29-4a4b-bd76-2738a9923a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3baddb74-186a-479e-9e1d-ee6c2462e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:47 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Volume d2e43456-e975-42c8-90bf-ae37bd972345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2e43456-e975-42c8-90bf-ae37bd972345', 'volume_size': 1} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159252318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e43456-e975-42c8-90bf-ae37bd972345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:47Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Creating volume d2e43456-e975-42c8-90bf-ae37bd972345 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:47 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:47 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 1073741824 Nov 06 21:57:47 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:47 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b1d97235-5c06-4b2f-9b51-576be1555d14" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-b1d97235-5c06-4b2f-9b51-576be1555d14" released by "delete_volume" :: held 0.746s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Created reservations ['eb83ea65-d89d-462c-b024-7ff3fdd82c36', '39fe7db9-ad3f-44a1-ae53-6724d9e38663', '3273bf71-edcf-4923-9ece-c58681b9c154', 'fbdc561d-0d1d-4e39-9ac4-df13e64d2488'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:47 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:47 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-40236e26-39f5-4f0c-8a27-64d40c6f1078-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:47 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 1073741824" returned: 0 in 0.527s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-40236e26-39f5-4f0c-8a27-64d40c6f1078-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:47 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.322s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:47 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 Nov 06 21:57:47 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Deleted volume successfully. Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "cinder-quobyte-40236e26-39f5-4f0c-8a27-64d40c6f1078" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-62246797-0753-466e-af17-084461da5eb0 tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-b1d97235-5c06-4b2f-9b51-576be1555d14-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-40236e26-39f5-4f0c-8a27-64d40c6f1078" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8990b6ca-84ce-4888-9455-7d2ad979f679]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:47 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 Nov 06 21:57:47 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:47 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345" returned: 0 in 0.278s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.856s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Creating offline snapshot 80557334-9f1e-4b73-832c-5fd727fbf30e of volume 9990a551-7301-4acd-a680-ef7350a02524 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3baddb74-186a-479e-9e1d-ee6c2462e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e43456-e975-42c8-90bf-ae37bd972345', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486c1f41-350b-4bc9-a3e7-bc03a19f57c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[8082f998-1b28-43ae-8cfa-05b0297cf5ff]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:48 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Volume volume-d2e43456-e975-42c8-90bf-ae37bd972345 (d2e43456-e975-42c8-90bf-ae37bd972345): created successfully Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486c1f41-350b-4bc9-a3e7-bc03a19f57c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (b77564c4-56f5-4707-aa0e-a6cb87b24b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e034e809-37c7-4919-95a5-b00cf17161e0 tempest-ProjectReaderTests-1763016005 None] Created volume successfully. Nov 06 21:57:48 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 Nov 06 21:57:48 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:48 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078" returned: 0 in 0.453s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:48 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078 Nov 06 21:57:48 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:48 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524" returned: 0 in 0.434s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:48 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e 1G Nov 06 21:57:48 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:48 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-40236e26-39f5-4f0c-8a27-64d40c6f1078" returned: 0 in 0.254s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-quobyte-40236e26-39f5-4f0c-8a27-64d40c6f1078" released by "delete_volume" :: held 0.764s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Created reservations ['052eaf85-5ac2-4402-998e-bbafb0e40b32', 'cf8e45c3-f536-428c-810b-5cd95b678198', 'a62186dd-231e-4838-b714-3636a204a4d9', '80afdd1f-917b-4287-86d1-f00ec147d520'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:48 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:48 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:48 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.276s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Deleted volume successfully. Nov 06 21:57:48 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e 1G" returned: 0 in 0.493s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990a551-7301-4acd-a680-ef7350a02524 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e1bfd590-0868-4875-85c0-a318ddc9f911 tempest-VolumeDependencyTests-2002005880 None] Lock "cinder-40236e26-39f5-4f0c-8a27-64d40c6f1078-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:48 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990a551-7301-4acd-a680-ef7350a02524 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e Nov 06 21:57:48 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:49 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990a551-7301-4acd-a680-ef7350a02524 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e" returned: 0 in 0.373s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:49 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e is being set with open permissions: ugo+rw Nov 06 21:57:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:49 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e Nov 06 21:57:49 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:49 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:49 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.info Nov 06 21:57:49 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:49 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.info" returned: 0 in 0.302s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:49 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.info is being set with open permissions: ugo+rw Nov 06 21:57:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:50 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.info Nov 06 21:57:50 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:50 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.info" returned: 0 in 0.314s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.345s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.113s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Creating offline snapshot 6e84e0f3-333b-428b-8875-c8fe3da45f03 of volume d2e43456-e975-42c8-90bf-ae37bd972345 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:57:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-349ac76b-2a06-4e81-8d3b-71814586433f tempest-CinderUnicodeTest-1922535591 None] Create snapshot completed successfully Nov 06 21:57:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d586736-671d-4dbc-8c3a-894d61b31f2e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:50 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 Nov 06 21:57:50 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:50 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345" returned: 0 in 0.385s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:50 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 1G Nov 06 21:57:50 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "cinder-80557334-9f1e-4b73-832c-5fd727fbf30e-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-80557334-9f1e-4b73-832c-5fd727fbf30e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "cinder-quobyte-9990a551-7301-4acd-a680-ef7350a02524" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-quobyte-9990a551-7301-4acd-a680-ef7350a02524" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "cinder-quobyte-80557334-9f1e-4b73-832c-5fd727fbf30e" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:51 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-quobyte-80557334-9f1e-4b73-832c-5fd727fbf30e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Deleting offline snapshot 80557334-9f1e-4b73-832c-5fd727fbf30e of volume 9990a551-7301-4acd-a680-ef7350a02524 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] snapshot_file for this snap is: volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 1G" returned: 0 in 0.547s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2e43456-e975-42c8-90bf-ae37bd972345 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c31919-bbe7-4ed2-8a80-7912250fdcab]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:51 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2e43456-e975-42c8-90bf-ae37bd972345 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 Nov 06 21:57:51 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:51 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e Nov 06 21:57:51 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:51 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2e43456-e975-42c8-90bf-ae37bd972345 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:51 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 is being set with open permissions: ugo+rw Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:51 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 Nov 06 21:57:51 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:51 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e" returned: 0 in 0.435s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9990a551-7301-4acd-a680-ef7350a02524(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab08ba0-8abe-457a-8f65-0e987a6a15b4]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:51 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 Nov 06 21:57:51 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:51 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03" returned: 0 in 0.316s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:52 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.info Nov 06 21:57:52 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:52 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524" returned: 0 in 0.420s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:52 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e Nov 06 21:57:52 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:52 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.info" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:52 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.info is being set with open permissions: ugo+rw Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:52 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.info Nov 06 21:57:52 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:52 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e" returned: 0 in 0.443s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:52 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.info" returned: 0 in 0.329s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:52 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e Nov 06 21:57:52 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-03201ccd-b0b5-4c85-9e71-e1482355056d tempest-ProjectReaderTests-1763016005 None] Create snapshot completed successfully Nov 06 21:57:52 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524.80557334-9f1e-4b73-832c-5fd727fbf30e" returned: 0 in 0.264s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-quobyte-80557334-9f1e-4b73-832c-5fd727fbf30e" released by "_delete_snapshot" :: held 1.733s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-quobyte-9990a551-7301-4acd-a680-ef7350a02524" released by "delete_snapshot" :: held 1.764s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Created reservations ['bb2c0cc6-d09c-44d6-886f-25b625eacaf4', '0a7cd887-8d32-4599-9968-494efbb30e02', '4502eb31-c7ab-497c-a453-775180b00b1b', '3362901b-4ab3-466c-b842-45934475d776'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Delete snapshot completed successfully. Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-28f7065a-97c3-4a07-9f10-f0f06e598390 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-80557334-9f1e-4b73-832c-5fd727fbf30e-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "cinder-9990a551-7301-4acd-a680-ef7350a02524-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-9990a551-7301-4acd-a680-ef7350a02524-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "cinder-quobyte-9990a551-7301-4acd-a680-ef7350a02524" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-quobyte-9990a551-7301-4acd-a680-ef7350a02524" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[999c0aec-5190-463f-a606-e6e212941e21]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:53 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 Nov 06 21:57:53 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-6e84e0f3-333b-428b-8875-c8fe3da45f03-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-6e84e0f3-333b-428b-8875-c8fe3da45f03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-d2e43456-e975-42c8-90bf-ae37bd972345" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-d2e43456-e975-42c8-90bf-ae37bd972345" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-6e84e0f3-333b-428b-8875-c8fe3da45f03" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-6e84e0f3-333b-428b-8875-c8fe3da45f03" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Deleting offline snapshot 6e84e0f3-333b-428b-8875-c8fe3da45f03 of volume d2e43456-e975-42c8-90bf-ae37bd972345 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] snapshot_file for this snap is: volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[04059cb8-9e4f-435a-8bc4-ac1125ee8a8f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:53 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524" returned: 0 in 0.429s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:54 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524 Nov 06 21:57:54 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:54 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 Nov 06 21:57:54 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:54 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-9990a551-7301-4acd-a680-ef7350a02524" returned: 0 in 0.328s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-quobyte-9990a551-7301-4acd-a680-ef7350a02524" released by "delete_volume" :: held 0.840s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:54 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03" returned: 0 in 0.463s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2e43456-e975-42c8-90bf-ae37bd972345(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Created reservations ['7a4f64d8-2211-4453-be5b-7af31d9f8fc3', 'a33f1f08-493d-4eb3-a48b-f0734ed55cd5', '2559ffbc-a1de-4045-80e9-33ba494a8802', '6b807520-a157-46cf-a44a-688705b531aa'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ad954-fb2c-4b99-8a38-a2e5d3e04cd1]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:54 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 Nov 06 21:57:54 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "cinder-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:54 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:54 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "cinder-quobyte-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-quobyte-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db397c-2576-4888-bd31-fc93304b3918]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:54 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba Nov 06 21:57:54 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:54 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.419s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:55 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345" returned: 0 in 0.581s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:55 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Deleted volume successfully. Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-bfb23c44-e055-4474-953f-6045b1268993 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-9990a551-7301-4acd-a680-ef7350a02524-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:55 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 Nov 06 21:57:55 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:55 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba" returned: 0 in 0.476s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:55 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba Nov 06 21:57:55 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:55 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03" returned: 0 in 0.488s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:55 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03 Nov 06 21:57:55 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:55 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Flow 'volume_create_manager' (3c1b6c8c-80d7-4a82-8380-823485288575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd096f39-d773-4df3-9704-5be76d94e750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba" returned: 0 in 0.414s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd096f39-d773-4df3-9704-5be76d94e750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfc32f4-b510-4fde-9756-5d710f1b176d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56040e00bb644160aeeb97bafafff5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:56Z,use_quota=True,user_id='144f79760570481ab78cdba015c2fe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7247b43-0c7f-4037-8233-8a27f1fa19d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7247b43-0c7f-4037-8233-8a27f1fa19d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e89451e-8530-4a8f-b836-c77d8a7297ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.image.glance [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Creating Keystone auth plugin from conf {{(pid=87069) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-quobyte-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba" released by "delete_volume" :: held 1.062s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:55 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345.6e84e0f3-333b-428b-8875-c8fe3da45f03" returned: 0 in 0.297s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-6e84e0f3-333b-428b-8875-c8fe3da45f03" released by "_delete_snapshot" :: held 1.976s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-d2e43456-e975-42c8-90bf-ae37bd972345" released by "delete_snapshot" :: held 2.005s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Created reservations ['3b356959-06eb-4059-abeb-c60921a6e55b', '8ca62e73-27c5-42db-87ee-50d3de560073', '80d1f71f-d27e-45cf-896f-31197a02b012', '6f9c2df3-0076-43eb-8c7e-9400ca6f8a71'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:55 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Created reservations ['68faa787-62b7-4650-8b7d-0d7eae60037c', '02af5ae5-9252-43b4-80f7-99578810ad58', 'f828d7df-75f9-44e1-a8fb-57e250eb48c1', '26e9f0ee-1aba-4d87-aaad-034d4aa0774e'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:56 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:56 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Delete snapshot completed successfully. Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-d8afa42d-562f-4730-b5e9-6c6fde8c2911 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-6e84e0f3-333b-428b-8875-c8fe3da45f03-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e89451e-8530-4a8f-b836-c77d8a7297ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bfc32f4-b510-4fde-9756-5d710f1b176d', 'volume_name': 'volume-0bfc32f4-b510-4fde-9756-5d710f1b176d', 'volume_size': 1, 'image_id': '46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b932c62897c7f849475ac859da492eee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56040e00bb644160aeeb97bafafff5c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d2299dd110f3d0a6b07bea20e4238b40f54baa2581fc3e2f605f0088ade43f1ab33e7f0b3cca3dc10f0e3ad1f39d564184f295fe98f811c802e3d8e733ac0ab', 'id': '46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'created_at': datetime.datetime(2026, 11, 6, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb/file', 'properties': {}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910330a5-75fa-4337-9778-d6189eb04251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910330a5-75fa-4337-9778-d6189eb04251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baa6b5d-f429-4f26-8ad6-8929005df397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:56 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Volume 0bfc32f4-b510-4fde-9756-5d710f1b176d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bfc32f4-b510-4fde-9756-5d710f1b176d', 'volume_size': 1, 'image_id': '46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b932c62897c7f849475ac859da492eee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56040e00bb644160aeeb97bafafff5c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d2299dd110f3d0a6b07bea20e4238b40f54baa2581fc3e2f605f0088ade43f1ab33e7f0b3cca3dc10f0e3ad1f39d564184f295fe98f811c802e3d8e733ac0ab', 'id': '46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'created_at': datetime.datetime(2026, 11, 6, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb/file', 'properties': {}}, 'image_service': } Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Trying to clone 0bfc32f4-b510-4fde-9756-5d710f1b176d from image 46b379d4-2ae4-44fb-a665-dff1a2bb09bb at location (None, [{'url': 'file:///opt/stack/data/glance/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'metadata': {}}]). {{(pid=87069) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:753}} Nov 06 21:57:56 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Image download 0.00 MB at 0.00 MB/s Nov 06 21:57:56 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.321s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e45ab7-7ef2-4cf0-b0fd-4f94cf532e2b]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Deleted volume successfully. Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-125bacf7-850a-472a-be0f-94432d5afe73 tempest-CinderUnicodeTest-1922535591 None] Lock "cinder-330e0c9f-8488-4f62-9423-7ae2ffd2c1ba-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Flow 'volume_create_manager' (a8bad5ff-45df-4c0d-9ca6-c50fc01a2d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:56 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD Nov 06 21:57:56 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fc5859-5708-4341-91de-49eb869c89b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fc5859-5708-4341-91de-49eb869c89b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129423947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819a8e9e-2b21-4376-90eb-71836d680f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb371990752c4fe096879659368e987f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:56Z,use_quota=True,user_id='15be31ec11604a0bb9ddbe70c6e2d88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dccb7c8-f306-49a9-9155-fa2cdf2f9a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dccb7c8-f306-49a9-9155-fa2cdf2f9a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02be6f3-782d-4009-a253-f35989029699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c02be6f3-782d-4009-a253-f35989029699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819a8e9e-2b21-4376-90eb-71836d680f73', 'volume_name': 'volume-819a8e9e-2b21-4376-90eb-71836d680f73', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9234c1b4-4646-4b8f-bf8c-f77ae853c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9234c1b4-4646-4b8f-bf8c-f77ae853c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e69cb3f-13f8-412b-8f72-8289531c0240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:56 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Volume 819a8e9e-2b21-4376-90eb-71836d680f73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819a8e9e-2b21-4376-90eb-71836d680f73', 'volume_size': 1} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129423947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=819a8e9e-2b21-4376-90eb-71836d680f73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb371990752c4fe096879659368e987f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:56Z,use_quota=True,user_id='15be31ec11604a0bb9ddbe70c6e2d88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Creating volume 819a8e9e-2b21-4376-90eb-71836d680f73 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:56 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:56 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 1073741824 Nov 06 21:57:56 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:56 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:56 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD Nov 06 21:57:56 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:57 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 1073741824" returned: 0 in 0.479s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:57 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Temporary image 46b379d4-2ae4-44fb-a665-dff1a2bb09bb is fetched for user 144f79760570481ab78cdba015c2fe72. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1452}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-d2e43456-e975-42c8-90bf-ae37bd972345-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Lock "cinder-d2e43456-e975-42c8-90bf-ae37bd972345-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:57 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 Nov 06 21:57:57 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddede88-695d-4fb2-b519-3c71a97916c7]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-d2e43456-e975-42c8-90bf-ae37bd972345" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-d2e43456-e975-42c8-90bf-ae37bd972345" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[87435032-a4a3-4701-900d-45a837d6b231]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:57 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD Nov 06 21:57:57 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:57 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 Nov 06 21:57:57 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:57 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73" returned: 0 in 0.339s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e69cb3f-13f8-412b-8f72-8289531c0240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819a8e9e-2b21-4376-90eb-71836d680f73', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db2c454-357f-4041-9cc2-2b7ee7f39f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:57 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Volume volume-819a8e9e-2b21-4376-90eb-71836d680f73 (819a8e9e-2b21-4376-90eb-71836d680f73): created successfully Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db2c454-357f-4041-9cc2-2b7ee7f39f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Flow 'volume_create_manager' (a8bad5ff-45df-4c0d-9ca6-c50fc01a2d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:57 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c9e5ab5f-db85-4d57-832e-08f0f8b9c026 tempest-ProjectReaderTests-1475018295 None] Created volume successfully. Nov 06 21:57:57 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:57 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345" returned: 0 in 0.450s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:57 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD Nov 06 21:57:57 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:57 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345 Nov 06 21:57:57 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:57 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bfc32f4-b510-4fde-9756-5d710f1b176d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56040e00bb644160aeeb97bafafff5c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:56Z,use_quota=True,user_id='144f79760570481ab78cdba015c2fe72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Creating volume 0bfc32f4-b510-4fde-9756-5d710f1b176d {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:58 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:58 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d2e43456-e975-42c8-90bf-ae37bd972345" returned: 0 in 0.290s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:58 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d 1073741824 Nov 06 21:57:58 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-d2e43456-e975-42c8-90bf-ae37bd972345" released by "delete_volume" :: held 0.830s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Created reservations ['03a6bb5d-511d-407c-b7a1-a8752011b1a6', '79ea2d21-5f08-46e6-bdd9-573343f28fbb', '372b1bd1-a346-406b-908c-da9bcccf4cac', '6bbc11ee-ec53-4b32-b078-48675cf3fa56'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:58 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:58 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:58 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d 1073741824" returned: 0 in 0.587s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:58 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.420s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:58 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Deleted volume successfully. Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-7bd65ac3-c964-47c4-93de-0cea17cae03c tempest-ProjectReaderTests-1763016005 None] Lock "cinder-d2e43456-e975-42c8-90bf-ae37bd972345-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:57:58 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d Nov 06 21:57:58 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:58 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:57:58 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (d4bd8326-2998-424c-9263-1672c189d638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8212625a-4492-4e0f-b5c6-1561d33c8fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8212625a-4492-4e0f-b5c6-1561d33c8fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576476487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b836151c-b649-497c-9fb2-d54dca63cd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:59Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500216ff-bb73-4756-928f-5a7b25f02ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:58 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500216ff-bb73-4756-928f-5a7b25f02ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb88c27-8c06-4f49-906e-12400619d7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb88c27-8c06-4f49-906e-12400619d7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b836151c-b649-497c-9fb2-d54dca63cd76', 'volume_name': 'volume-b836151c-b649-497c-9fb2-d54dca63cd76', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e8b6e4-1540-4185-aea7-c4009703b567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e8b6e4-1540-4185-aea7-c4009703b567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228883ab-67ed-4ccc-8d99-2163aaf53f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:57:59 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Volume b836151c-b649-497c-9fb2-d54dca63cd76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b836151c-b649-497c-9fb2-d54dca63cd76', 'volume_size': 1} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:59 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d" returned: 0 in 0.391s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576476487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b836151c-b649-497c-9fb2-d54dca63cd76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:57:59Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Creating volume b836151c-b649-497c-9fb2-d54dca63cd76 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:57:59 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:59 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 1073741824 Nov 06 21:57:59 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Attempting download of 46b379d4-2ae4-44fb-a665-dff1a2bb09bb ((None, [{'url': 'file:///opt/stack/data/glance/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'metadata': {}}])) to volume 0bfc32f4-b510-4fde-9756-5d710f1b176d. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 21:57:59 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.412s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Acquiring lock "cinder-819a8e9e-2b21-4376-90eb-71836d680f73-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c3f52e-05e4-44bd-b587-201f79b1cf4a]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_l2bbui77 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Lock "cinder-819a8e9e-2b21-4376-90eb-71836d680f73-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Acquiring lock "cinder-quobyte-819a8e9e-2b21-4376-90eb-71836d680f73" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Lock "cinder-quobyte-819a8e9e-2b21-4376-90eb-71836d680f73" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[86184711-92f6-45f8-8f6c-bbcbbaa90849]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:59 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_l2bbui77 Nov 06 21:57:59 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:59 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 Nov 06 21:57:59 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:59 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_l2bbui77" returned: 0 in 0.414s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_l2bbui77 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:59 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 1073741824" returned: 0 in 0.590s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:59 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 Nov 06 21:57:59 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:59 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_l2bbui77 Nov 06 21:57:59 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:57:59 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73" returned: 0 in 0.523s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:57:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:57:59 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73 Nov 06 21:57:59 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:00 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76" returned: 0 in 0.306s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228883ab-67ed-4ccc-8d99-2163aaf53f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b836151c-b649-497c-9fb2-d54dca63cd76', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2651e885-2280-4bb9-aa9a-e5c236dbf1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:00 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:00 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Volume volume-b836151c-b649-497c-9fb2-d54dca63cd76 (b836151c-b649-497c-9fb2-d54dca63cd76): created successfully Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2651e885-2280-4bb9-aa9a-e5c236dbf1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (d4bd8326-2998-424c-9263-1672c189d638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_l2bbui77" returned: 1 in 0.440s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_l2bbui77' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e880dcf-5979-4fd4-9748-b82dcc0464be]: (4, 'raw') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:00 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7eeb1202-69a9-4305-8852-3af2fc17ac68 tempest-ProjectReaderTests-1763016005 None] Created volume successfully. Nov 06 21:58:00 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-819a8e9e-2b21-4376-90eb-71836d680f73" returned: 0 in 0.328s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:00 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD Nov 06 21:58:00 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Lock "cinder-quobyte-819a8e9e-2b21-4376-90eb-71836d680f73" released by "delete_volume" :: held 0.911s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Created reservations ['451c7ac2-fd7a-4afb-a1be-05f33ac297f4', '6eec7886-48d9-4f38-b189-d423473ae19a', '63cd9b9f-8d9d-4bb5-87fe-45c302f24b81', '49b96eda-710c-48c5-a258-d0284d094862'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:00 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:00 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:00 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:00 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD Nov 06 21:58:00 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:00 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.303s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:00 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Deleted volume successfully. Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e8ef60e2-f933-49d3-a9be-a1ff515d83b4 tempest-ProjectReaderTests-1475018295 None] Lock "cinder-819a8e9e-2b21-4376-90eb-71836d680f73-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:00 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] 46b379d4-2ae4-44fb-a665-dff1a2bb09bb was raw, converting to qcow2 {{(pid=87069) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1141}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:00 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d Nov 06 21:58:00 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Flow 'volume_create_manager' (351d1551-13e3-4199-9527-583c3603e0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0796f61-27a0-47d2-83a8-c95687df6a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:00 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0796f61-27a0-47d2-83a8-c95687df6a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299054692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941cde6f-057b-443c-836c-ee7368e73d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb371990752c4fe096879659368e987f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:01Z,use_quota=True,user_id='15be31ec11604a0bb9ddbe70c6e2d88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef5fdc7-4f31-4d4c-9ea0-7c4b89394462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef5fdc7-4f31-4d4c-9ea0-7c4b89394462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a22d13-c0d9-4b84-83c6-455b50640eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a22d13-c0d9-4b84-83c6-455b50640eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941cde6f-057b-443c-836c-ee7368e73d53', 'volume_name': 'volume-941cde6f-057b-443c-836c-ee7368e73d53', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d68f0b-c2b9-4556-ac41-a0402834af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d68f0b-c2b9-4556-ac41-a0402834af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10713cb-ac56-4ad1-bb41-022448ea7ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Volume 941cde6f-057b-443c-836c-ee7368e73d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941cde6f-057b-443c-836c-ee7368e73d53', 'volume_size': 1} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-299054692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941cde6f-057b-443c-836c-ee7368e73d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb371990752c4fe096879659368e987f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:01Z,use_quota=True,user_id='15be31ec11604a0bb9ddbe70c6e2d88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Creating volume 941cde6f-057b-443c-836c-ee7368e73d53 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:01 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:01 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 1073741824 Nov 06 21:58:01 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:01 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d" returned: 0 in 0.576s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_46b379d4-2ae4-44fb-a665-dff1a2bb09bb_qlmfklkwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:58:01 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:01 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d 1G Nov 06 21:58:01 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:01 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 1073741824" returned: 0 in 0.519s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:01 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 Nov 06 21:58:01 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (61a654c1-b778-4719-8eec-4860e939a10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a80b90-a741-4f10-8296-dd81cd79c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a80b90-a741-4f10-8296-dd81cd79c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1333965373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0369e9-5f31-45ef-a3cc-46e8984ded8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:02Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778b6f06-b160-40db-8634-44a972832942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778b6f06-b160-40db-8634-44a972832942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca91977-f7b3-4485-b1ed-75f8d25e627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca91977-f7b3-4485-b1ed-75f8d25e627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0369e9-5f31-45ef-a3cc-46e8984ded8d', 'volume_name': 'volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54009d5c-483c-4905-a70e-482f69f2c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54009d5c-483c-4905-a70e-482f69f2c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07465394-0cd5-4c19-94b9-6ccc8bd891fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Volume 5d0369e9-5f31-45ef-a3cc-46e8984ded8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d', 'volume_size': 1} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:01 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d 1G" returned: 0 in 0.347s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Downloaded image 46b379d4-2ae4-44fb-a665-dff1a2bb09bb ((None, [{'url': 'file:///opt/stack/data/glance/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'metadata': {}}])) to volume 0bfc32f4-b510-4fde-9756-5d710f1b176d successfully. {{(pid=87069) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Temporary image 46b379d4-2ae4-44fb-a665-dff1a2bb09bb for user 144f79760570481ab78cdba015c2fe72 is deleted. {{(pid=87069) fetch /opt/stack/cinder/cinder/image/image_utils.py:1456}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.volume_utils [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Marking volume 0bfc32f4-b510-4fde-9756-5d710f1b176d as bootable. {{(pid=87069) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Copying metadata from image 46b379d4-2ae4-44fb-a665-dff1a2bb09bb to 0bfc32f4-b510-4fde-9756-5d710f1b176d. {{(pid=87069) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Creating volume glance metadata for volume 0bfc32f4-b510-4fde-9756-5d710f1b176d backed by image 46b379d4-2ae4-44fb-a665-dff1a2bb09bb with: {'image_id': '46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b932c62897c7f849475ac859da492eee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87069) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baa6b5d-f429-4f26-8ad6-8929005df397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bfc32f4-b510-4fde-9756-5d710f1b176d', 'volume_size': 1, 'image_id': '46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b932c62897c7f849475ac859da492eee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '56040e00bb644160aeeb97bafafff5c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4d2299dd110f3d0a6b07bea20e4238b40f54baa2581fc3e2f605f0088ade43f1ab33e7f0b3cca3dc10f0e3ad1f39d564184f295fe98f811c802e3d8e733ac0ab', 'id': '46b379d4-2ae4-44fb-a665-dff1a2bb09bb', 'created_at': datetime.datetime(2026, 11, 6, 20, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 20, 57, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46b379d4-2ae4-44fb-a665-dff1a2bb09bb/file', 'properties': {}}, 'image_service': }' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528990cb-b944-467f-831c-0d0a04bd09bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.249s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10713cb-ac56-4ad1-bb41-022448ea7ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941cde6f-057b-443c-836c-ee7368e73d53', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299900c8-44df-476c-a7db-66ec64f8275a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:01 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Volume volume-0bfc32f4-b510-4fde-9756-5d710f1b176d (0bfc32f4-b510-4fde-9756-5d710f1b176d): created successfully Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528990cb-b944-467f-831c-0d0a04bd09bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Flow 'volume_create_manager' (3c1b6c8c-80d7-4a82-8380-823485288575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:01 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Volume volume-941cde6f-057b-443c-836c-ee7368e73d53 (941cde6f-057b-443c-836c-ee7368e73d53): created successfully Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299900c8-44df-476c-a7db-66ec64f8275a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Flow 'volume_create_manager' (351d1551-13e3-4199-9527-583c3603e0a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Creating offline snapshot 507d2744-9e54-46f9-9d4f-c4137157661a of volume b836151c-b649-497c-9fb2-d54dca63cd76 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:01 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-de5a951c-7b54-485c-b242-d9c0149171ac tempest-VolumeImageDependencyTests-977797832 None] Created volume successfully. Nov 06 21:58:01 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-67f7f59a-e73c-4a3c-a246-48b318b0597c tempest-ProjectReaderTests-1475018295 None] Created volume successfully. Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c02cab-2e7c-4200-84d8-8c6d68c87494]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:02 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 Nov 06 21:58:02 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Acquiring lock "cinder-0bfc32f4-b510-4fde-9756-5d710f1b176d-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Lock "cinder-0bfc32f4-b510-4fde-9756-5d710f1b176d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Acquiring lock "cinder-quobyte-0bfc32f4-b510-4fde-9756-5d710f1b176d" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Lock "cinder-quobyte-0bfc32f4-b510-4fde-9756-5d710f1b176d" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45a1f1-4099-4cd4-9c6c-4577d29ffbae]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:02 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76" returned: 0 in 0.373s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:02 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a 1G Nov 06 21:58:02 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:02 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d Nov 06 21:58:02 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:02 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d" returned: 0 in 0.414s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:02 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d Nov 06 21:58:02 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:02 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a 1G" returned: 0 in 0.445s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b836151c-b649-497c-9fb2-d54dca63cd76 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:02 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b836151c-b649-497c-9fb2-d54dca63cd76 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a Nov 06 21:58:02 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:02 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-0bfc32f4-b510-4fde-9756-5d710f1b176d" returned: 0 in 0.273s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Lock "cinder-quobyte-0bfc32f4-b510-4fde-9756-5d710f1b176d" released by "delete_volume" :: held 0.740s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Acquiring lock "cinder-941cde6f-057b-443c-836c-ee7368e73d53-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Created reservations ['215d388e-8d43-4c63-9a15-6de113b94eb2', '53a1ec84-b28b-4c86-91bc-451411ed334c', '45927f96-cb5f-4468-b095-da770bbd360e', 'b77e4f77-e0a0-4714-ab8b-98ecec9a84c6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Lock "cinder-941cde6f-057b-443c-836c-ee7368e73d53-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:03 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b836151c-b649-497c-9fb2-d54dca63cd76 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:03 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a is being set with open permissions: ugo+rw Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Acquiring lock "cinder-quobyte-941cde6f-057b-443c-836c-ee7368e73d53" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:03 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a Nov 06 21:58:03 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Lock "cinder-quobyte-941cde6f-057b-443c-836c-ee7368e73d53" acquired by "delete_volume" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7b7ec9-c1f4-4bc4-8768-64ead7b81f67]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:03 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:03 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:03 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 Nov 06 21:58:03 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:03 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a" returned: 0 in 0.293s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:03 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.info Nov 06 21:58:03 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:03 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.326s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Deleted volume successfully. Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63f125c9-1164-4351-8050-89db15aa2447 tempest-VolumeImageDependencyTests-977797832 None] Lock "cinder-0bfc32f4-b510-4fde-9756-5d710f1b176d-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:03 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53" returned: 0 in 0.450s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:03 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53 Nov 06 21:58:03 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:03 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.info" returned: 0 in 0.319s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:03 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.info is being set with open permissions: ugo+rw Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:03 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.info Nov 06 21:58:03 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:03 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-941cde6f-057b-443c-836c-ee7368e73d53" returned: 0 in 0.272s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Lock "cinder-quobyte-941cde6f-057b-443c-836c-ee7368e73d53" released by "delete_volume" :: held 0.782s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Created reservations ['1c3c94a8-761a-48ad-872b-62c2b06b7b3a', 'e80563ab-a598-434f-b394-09d8f8e3bfb4', 'c52b1dfc-02b1-4644-b4de-c2923b022f94', 'd9b479db-2672-4d1a-ac87-31a954ad3fb5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:04 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.info" returned: 0 in 0.276s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.351s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1333965373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0369e9-5f31-45ef-a3cc-46e8984ded8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:02Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Creating volume 5d0369e9-5f31-45ef-a3cc-46e8984ded8d {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:04 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:04 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d 1073741824 Nov 06 21:58:04 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:04 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:04 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-147c6ed2-d4b4-4c51-81db-9fa8cbdde19d tempest-ProjectReaderTests-1763016005 None] Create snapshot completed successfully Nov 06 21:58:04 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.351s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Deleted volume successfully. Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=244,cinder:UPDATE=305,cinder:INSERT=93,cinder:DELETE=31 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63b0034f-000a-4cab-89c1-651e52961d62 tempest-ProjectReaderTests-1475018295 None] Lock "cinder-941cde6f-057b-443c-836c-ee7368e73d53-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-507d2744-9e54-46f9-9d4f-c4137157661a-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-507d2744-9e54-46f9-9d4f-c4137157661a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-b836151c-b649-497c-9fb2-d54dca63cd76" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-b836151c-b649-497c-9fb2-d54dca63cd76" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-507d2744-9e54-46f9-9d4f-c4137157661a" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-507d2744-9e54-46f9-9d4f-c4137157661a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Deleting offline snapshot 507d2744-9e54-46f9-9d4f-c4137157661a of volume b836151c-b649-497c-9fb2-d54dca63cd76 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] snapshot_file for this snap is: volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:04 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d 1073741824" returned: 0 in 0.691s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=340,cinder:SELECT=227,cinder:INSERT=78,cinder:DELETE=27 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[55781a7a-697d-4bdf-87de-d470ef926288]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:04 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d Nov 06 21:58:04 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:04 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a Nov 06 21:58:04 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:05 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" returned: 0 in 0.309s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07465394-0cd5-4c19-94b9-6ccc8bd891fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5970fe55-b041-4bd9-980a-3fb35d584e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:05 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Volume volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d (5d0369e9-5f31-45ef-a3cc-46e8984ded8d): created successfully Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5970fe55-b041-4bd9-980a-3fb35d584e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (61a654c1-b778-4719-8eec-4860e939a10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:05 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-d670b6d3-81fd-4579-8e2c-38df5d6eeb6e tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:58:05 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a" returned: 0 in 0.471s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b836151c-b649-497c-9fb2-d54dca63cd76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b377161-fe0e-4cae-9e73-a04f95590f55]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:05 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 Nov 06 21:58:05 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:05 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76" returned: 0 in 0.455s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:05 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a Nov 06 21:58:05 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:06 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a" returned: 0 in 0.481s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:06 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a Nov 06 21:58:06 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot c046b769-80c4-4d18-9191-38da875703a1 of volume 5d0369e9-5f31-45ef-a3cc-46e8984ded8d {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f64767-c222-41a8-ad37-c7e98ccc426e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:06 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d Nov 06 21:58:06 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:06 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76.507d2744-9e54-46f9-9d4f-c4137157661a" returned: 0 in 0.338s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-507d2744-9e54-46f9-9d4f-c4137157661a" released by "_delete_snapshot" :: held 1.911s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-b836151c-b649-497c-9fb2-d54dca63cd76" released by "delete_snapshot" :: held 1.952s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Created reservations ['d9d9099d-1d7e-44da-afea-fe7eea7d03f9', '7ce73bad-40ea-4857-971a-3fb0e52e36a2', 'd1978b8f-b918-45ec-b6ac-c4ad97067885', '434812d9-f88b-4c5d-b414-d0e13cce13da'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Delete snapshot completed successfully. Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-55e53e4d-6f6e-44ce-afdf-2e8340be0758 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-507d2744-9e54-46f9-9d4f-c4137157661a-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-b836151c-b649-497c-9fb2-d54dca63cd76-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:06 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Lock "cinder-b836151c-b649-497c-9fb2-d54dca63cd76-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" returned: 0 in 0.524s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:07 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 1G Nov 06 21:58:07 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-b836151c-b649-497c-9fb2-d54dca63cd76" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-b836151c-b649-497c-9fb2-d54dca63cd76" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ff46b4-35fb-45e4-afb4-b26b307b75ac]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:07 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 Nov 06 21:58:07 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:07 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 1G" returned: 0 in 0.572s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:07 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:07 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 Nov 06 21:58:07 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76" returned: 0 in 0.474s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:07 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76 Nov 06 21:58:07 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:07 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b836151c-b649-497c-9fb2-d54dca63cd76" returned: 0 in 0.324s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:07 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1" returned: 0 in 0.394s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:07 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 is being set with open permissions: ugo+rw Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-b836151c-b649-497c-9fb2-d54dca63cd76" released by "delete_volume" :: held 0.911s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:07 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 Nov 06 21:58:07 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Created reservations ['2f7450d0-3839-4776-9bfc-61f491e4041c', 'b46874e2-e93f-45a0-9578-70c0858b5aa4', 'fffd8be6-0ea0-462a-8483-20d58146e39b', '0ae4c62f-ed39-4175-b4a5-8f0e500ad294'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:08 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:08 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:08 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1" returned: 0 in 0.318s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:08 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.info Nov 06 21:58:08 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:08 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.289s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Deleted volume successfully. Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-daeffb4a-6559-46d1-986b-cf2d36e19b1b tempest-ProjectReaderTests-1763016005 None] Lock "cinder-b836151c-b649-497c-9fb2-d54dca63cd76-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:08 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.info" returned: 0 in 0.306s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:08 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.info is being set with open permissions: ugo+rw Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:08 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.info Nov 06 21:58:08 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:08 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.info" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-77a96478-8258-4cc6-8373-83bc9cad87be tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-c046b769-80c4-4d18-9191-38da875703a1-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-c046b769-80c4-4d18-9191-38da875703a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-c046b769-80c4-4d18-9191-38da875703a1" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (860afbd6-f4c9-4108-9f3c-68afbfe51c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377e1467-0bce-4f0c-9981-a23853d77fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-c046b769-80c4-4d18-9191-38da875703a1" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot c046b769-80c4-4d18-9191-38da875703a1 of volume 5d0369e9-5f31-45ef-a3cc-46e8984ded8d {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377e1467-0bce-4f0c-9981-a23853d77fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305694186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ba9913-d72a-4101-85a9-89391267bf32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:10Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def54ecc-5429-46f8-a0d8-bf327890d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def54ecc-5429-46f8-a0d8-bf327890d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e79637-dadd-456e-b3bf-e55cc3f3b2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e79637-dadd-456e-b3bf-e55cc3f3b2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ba9913-d72a-4101-85a9-89391267bf32', 'volume_name': 'volume-a3ba9913-d72a-4101-85a9-89391267bf32', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e04c3f-bf13-4013-a75b-c8eece76d8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e04c3f-bf13-4013-a75b-c8eece76d8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f5f277-3007-4f4a-9aeb-ae04eaff6bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:09 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Volume a3ba9913-d72a-4101-85a9-89391267bf32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ba9913-d72a-4101-85a9-89391267bf32', 'volume_size': 1} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305694186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ba9913-d72a-4101-85a9-89391267bf32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:10Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Creating volume a3ba9913-d72a-4101-85a9-89391267bf32 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:09 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d516cb55-0b59-4569-b8d6-f98cd62e3b63]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:09 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 1073741824 Nov 06 21:58:09 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:10 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 Nov 06 21:58:10 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:10 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1" returned: 0 in 0.477s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c160a-4f3f-430c-9a75-c60cb96c4b02]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:10 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 1073741824" returned: 0 in 0.619s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:10 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d Nov 06 21:58:10 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:10 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 Nov 06 21:58:10 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:10 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32" returned: 0 in 0.322s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:10 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f5f277-3007-4f4a-9aeb-ae04eaff6bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ba9913-d72a-4101-85a9-89391267bf32', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4beb0a-86e2-4fc6-82cb-a1e85964ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" returned: 0 in 0.493s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:10 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Volume volume-a3ba9913-d72a-4101-85a9-89391267bf32 (a3ba9913-d72a-4101-85a9-89391267bf32): created successfully Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4beb0a-86e2-4fc6-82cb-a1e85964ad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (860afbd6-f4c9-4108-9f3c-68afbfe51c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:10 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 Nov 06 21:58:10 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:10 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c7e25497-bb49-4a24-b4c7-7a5684c3d1ec tempest-ProjectReaderTests-1763016005 None] Created volume successfully. Nov 06 21:58:11 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1" returned: 0 in 0.422s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:11 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1 Nov 06 21:58:11 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:11 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d.c046b769-80c4-4d18-9191-38da875703a1" returned: 0 in 0.295s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-c046b769-80c4-4d18-9191-38da875703a1" released by "_delete_snapshot" :: held 1.921s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" released by "delete_snapshot" :: held 1.988s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:11 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Created reservations ['3a6f8f6b-65de-4e63-a375-41a14edcb177', 'f9bace44-8127-4746-89e3-1e30781c4636', 'aca13ace-3fc2-448d-a6be-484c8ad2e0d2', 'bdd3e838-3928-4f00-b65d-21747b374352'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:58:11 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30b3b363-32eb-43f2-a8ee-64ec8352d565 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-c046b769-80c4-4d18-9191-38da875703a1-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Creating offline snapshot f4cae871-5a1c-4576-9014-619a4c41eb6c of volume a3ba9913-d72a-4101-85a9-89391267bf32 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:12 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29de571-8941-4abb-86ce-7663370d4249]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:12 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 Nov 06 21:58:12 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:12 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32" returned: 0 in 0.415s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:12 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c 1G Nov 06 21:58:12 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:12 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-5d0369e9-5f31-45ef-a3cc-46e8984ded8d-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Lock "cinder-5d0369e9-5f31-45ef-a3cc-46e8984ded8d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:13 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c 1G" returned: 0 in 0.495s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ba9913-d72a-4101-85a9-89391267bf32 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:13 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ba9913-d72a-4101-85a9-89391267bf32 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c Nov 06 21:58:13 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[86280a8a-ffe2-4596-ac6d-2effe1dcdbc2]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:13 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d Nov 06 21:58:13 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:13 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3ba9913-d72a-4101-85a9-89391267bf32 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c" returned: 0 in 0.331s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:13 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c is being set with open permissions: ugo+rw Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:13 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c Nov 06 21:58:13 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:13 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" returned: 0 in 0.433s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:13 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d Nov 06 21:58:13 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:13 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c" returned: 0 in 0.303s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:13 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.info Nov 06 21:58:13 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:13 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" returned: 0 in 0.267s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-5d0369e9-5f31-45ef-a3cc-46e8984ded8d" released by "delete_volume" :: held 0.762s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Created reservations ['56f68892-70c7-4370-af53-74bb493475a7', '20c1d3b8-c275-4c18-9bb9-ec1829326298', 'fd79188d-7e85-4db7-af7b-237ab8434358', '961526b2-028a-4442-ae51-2e82b6553fb6'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:13 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.info" returned: 0 in 0.278s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:14 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.info is being set with open permissions: ugo+rw Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:14 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:14 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:14 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.info Nov 06 21:58:14 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:14 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.240s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0102375e-c7d5-4ebf-9ba0-05af3a7169bd tempest-ProjectMemberTests-1193509755 None] Lock "cinder-5d0369e9-5f31-45ef-a3cc-46e8984ded8d-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:14 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.info" returned: 0 in 0.280s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.203s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:14 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-32eb160c-8e20-41db-8fea-10c7390ba2d3 tempest-ProjectReaderTests-1763016005 None] Create snapshot completed successfully Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (15e82ccb-12d5-4d6d-85c3-c6ff78a07293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4fc11f-7309-42e5-9bf3-4d82f3fb639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4fc11f-7309-42e5-9bf3-4d82f3fb639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712730052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f2ef10-8da7-4570-b87a-e49f17b02d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:15Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d79535-4c5d-40a3-8c46-bbe5f898fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d79535-4c5d-40a3-8c46-bbe5f898fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f9d195-3f28-4ea0-acd4-34c2c9d98abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f9d195-3f28-4ea0-acd4-34c2c9d98abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f2ef10-8da7-4570-b87a-e49f17b02d28', 'volume_name': 'volume-29f2ef10-8da7-4570-b87a-e49f17b02d28', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267bc664-1229-4644-83d7-5682a489f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267bc664-1229-4644-83d7-5682a489f643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35630301-bd08-459f-b153-37e03729d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:14 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Volume 29f2ef10-8da7-4570-b87a-e49f17b02d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f2ef10-8da7-4570-b87a-e49f17b02d28', 'volume_size': 1} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1712730052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f2ef10-8da7-4570-b87a-e49f17b02d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:15Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Creating volume 29f2ef10-8da7-4570-b87a-e49f17b02d28 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:14 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:14 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 1073741824 Nov 06 21:58:14 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:15 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 1073741824" returned: 0 in 0.469s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:15 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 Nov 06 21:58:15 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-f4cae871-5a1c-4576-9014-619a4c41eb6c-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-f4cae871-5a1c-4576-9014-619a4c41eb6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-a3ba9913-d72a-4101-85a9-89391267bf32" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-a3ba9913-d72a-4101-85a9-89391267bf32" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-f4cae871-5a1c-4576-9014-619a4c41eb6c" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-f4cae871-5a1c-4576-9014-619a4c41eb6c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Deleting offline snapshot f4cae871-5a1c-4576-9014-619a4c41eb6c of volume a3ba9913-d72a-4101-85a9-89391267bf32 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] snapshot_file for this snap is: volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[328a46ee-1024-4659-b806-616e2a3a76c9]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:15 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28" returned: 0 in 0.314s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35630301-bd08-459f-b153-37e03729d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f2ef10-8da7-4570-b87a-e49f17b02d28', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:15 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c Nov 06 21:58:15 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b2eb17-17a1-416f-a5c6-8e2b6afadfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:15 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Volume volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 (29f2ef10-8da7-4570-b87a-e49f17b02d28): created successfully Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b2eb17-17a1-416f-a5c6-8e2b6afadfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (15e82ccb-12d5-4d6d-85c3-c6ff78a07293) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:15 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-83c5e2cf-5ca1-4b34-9d50-64bbeaaae4f7 tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:58:15 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c" returned: 0 in 0.392s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3ba9913-d72a-4101-85a9-89391267bf32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac104f6b-5161-4517-9ad8-732979c1d57e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:15 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 Nov 06 21:58:15 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:16 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:16 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c Nov 06 21:58:16 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:16 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c" returned: 0 in 0.315s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:16 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c Nov 06 21:58:16 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:16 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32.f4cae871-5a1c-4576-9014-619a4c41eb6c" returned: 0 in 0.301s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-f4cae871-5a1c-4576-9014-619a4c41eb6c" released by "_delete_snapshot" :: held 1.506s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-a3ba9913-d72a-4101-85a9-89391267bf32" released by "delete_snapshot" :: held 1.535s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot 69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 of volume 29f2ef10-8da7-4570-b87a-e49f17b02d28 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c4888a-c2c1-4af1-8f89-cb48e1ab0791]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:16 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Created reservations ['4e2d94ac-733c-4680-be0a-5052b44c8c20', '7062a076-6e36-4d6d-b126-1ecbfb2b2c4b', '99cd19bd-03e0-4658-868c-7083d87c5f9e', '5d6cb431-9b74-4dd2-97df-ef3cec275088'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:17 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Delete snapshot completed successfully. Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f4e900a8-2c4b-4d7b-8795-a5e43d6d7c88 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-f4cae871-5a1c-4576-9014-619a4c41eb6c-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:17 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 Nov 06 21:58:17 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:17 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28" returned: 0 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:17 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 1G Nov 06 21:58:17 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-a3ba9913-d72a-4101-85a9-89391267bf32-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-a3ba9913-d72a-4101-85a9-89391267bf32-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-a3ba9913-d72a-4101-85a9-89391267bf32" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-a3ba9913-d72a-4101-85a9-89391267bf32" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d959b530-25c9-4060-8ff5-47fecbdb2c6e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:17 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 Nov 06 21:58:17 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:17 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 1G" returned: 0 in 0.509s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:17 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 Nov 06 21:58:17 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:18 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32" returned: 0 in 0.448s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:18 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32 Nov 06 21:58:18 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:18 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54" returned: 0 in 0.361s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:18 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 is being set with open permissions: ugo+rw Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:18 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 Nov 06 21:58:18 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:18 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a3ba9913-d72a-4101-85a9-89391267bf32" returned: 0 in 0.261s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-a3ba9913-d72a-4101-85a9-89391267bf32" released by "delete_volume" :: held 0.790s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Created reservations ['203b3e65-93d7-4c4b-a6f2-be83d41485df', '3eb1b70a-673a-4452-a20a-f591b2d8bbc6', 'bc4a23c7-630d-4b13-a24b-8bc5ec85d15f', '41e5841d-3782-4b6e-9c34-7615fb8600b5'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:18 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54" returned: 0 in 0.280s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:18 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:18 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:18 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.info Nov 06 21:58:18 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:18 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.296s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:18 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Deleted volume successfully. Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e4048dcf-9c93-4c9c-bab7-6ad9d9684ba9 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-a3ba9913-d72a-4101-85a9-89391267bf32-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:18 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.info" returned: 0 in 0.359s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:18 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.info is being set with open permissions: ugo+rw Nov 06 21:58:18 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:18 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.info Nov 06 21:58:18 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:19 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (3d374674-a2d4-4242-9d8f-b3e971651c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3073705c-4286-4ed1-84dd-35a323a1a945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.info" returned: 0 in 0.310s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3073705c-4286-4ed1-84dd-35a323a1a945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701544215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08c91f7-cd86-43bc-9948-cf8b776cd6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:19Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798ad53e-f14f-48e2-bff7-4971c9f12293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798ad53e-f14f-48e2-bff7-4971c9f12293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9045810-45b2-4306-9e0d-771107b92028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9045810-45b2-4306-9e0d-771107b92028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08c91f7-cd86-43bc-9948-cf8b776cd6c1', 'volume_name': 'volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a7b265-b241-4242-80e9-e11ba4074352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a7b265-b241-4242-80e9-e11ba4074352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d6592f-8e0e-47ba-af3a-bb3e4973ca2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:19 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Volume f08c91f7-cd86-43bc-9948-cf8b776cd6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1', 'volume_size': 1} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701544215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08c91f7-cd86-43bc-9948-cf8b776cd6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:19Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Creating volume f08c91f7-cd86-43bc-9948-cf8b776cd6c1 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:19 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:19 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 1073741824 Nov 06 21:58:19 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:19 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-2ef2f72c-1895-4a62-9d2c-79086a9b9dc6 tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:58:19 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 1073741824" returned: 0 in 0.414s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:19 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 Nov 06 21:58:19 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:19 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" returned: 0 in 0.254s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:19 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d6592f-8e0e-47ba-af3a-bb3e4973ca2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69afb7e-081e-4a16-8ad9-94f21891afc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:20 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Volume volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 (f08c91f7-cd86-43bc-9948-cf8b776cd6c1): created successfully Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69afb7e-081e-4a16-8ad9-94f21891afc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (3d374674-a2d4-4242-9d8f-b3e971651c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:20 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-61e5e136-ecaa-4d8f-9493-4a8e4db1933b tempest-ProjectReaderTests-1763016005 None] Created volume successfully. Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-29f2ef10-8da7-4570-b87a-e49f17b02d28" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-29f2ef10-8da7-4570-b87a-e49f17b02d28" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot 69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 of volume 29f2ef10-8da7-4570-b87a-e49f17b02d28 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c40ea-0900-4f6c-b8be-d081bc73b4fd]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:20 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 Nov 06 21:58:20 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Creating offline snapshot 4eade9aa-39bf-4406-97b1-278010f281e7 of volume f08c91f7-cd86-43bc-9948-cf8b776cd6c1 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6452a4-50f3-426f-ad52-b186484b9f67]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:20 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 Nov 06 21:58:20 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:20 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29f2ef10-8da7-4570-b87a-e49f17b02d28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[68193d8b-da29-4e9c-b1d1-bb2444fd8a21]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:20 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 Nov 06 21:58:20 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:20 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" returned: 0 in 0.377s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:20 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 1G Nov 06 21:58:20 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:20 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28" returned: 0 in 0.366s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:20 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:20 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 Nov 06 21:58:20 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:21 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 1G" returned: 0 in 0.424s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:21 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 Nov 06 21:58:21 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:21 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54" returned: 0 in 0.357s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:21 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54 Nov 06 21:58:21 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:21 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:21 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 is being set with open permissions: ugo+rw Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:21 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 Nov 06 21:58:21 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:21 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28.69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54" returned: 0 in 0.262s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54" released by "_delete_snapshot" :: held 1.495s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-29f2ef10-8da7-4570-b87a-e49f17b02d28" released by "delete_snapshot" :: held 1.518s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Created reservations ['6e266ac5-e39a-404b-aaba-676ab6017b98', 'ca0fde2e-895c-490a-918f-f765f7daee74', '901a6a3c-53aa-4eb6-b95a-a7c8babddcc6', 'f8a3c7e9-aafa-4c6c-a674-4caf2ea550e1'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:21 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-45b4f6f3-f411-40dc-9f30-c5cb6c840556 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-69ab67e4-f1c1-4f9d-93e7-9c1bc8954d54-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:21 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7" returned: 0 in 0.254s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:21 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:21 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.info Nov 06 21:58:21 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:22 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.info" returned: 0 in 0.247s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:22 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.info is being set with open permissions: ugo+rw Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:22 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.info Nov 06 21:58:22 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-29f2ef10-8da7-4570-b87a-e49f17b02d28-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-29f2ef10-8da7-4570-b87a-e49f17b02d28-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:22 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.info" returned: 0 in 0.282s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-29f2ef10-8da7-4570-b87a-e49f17b02d28" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-29f2ef10-8da7-4570-b87a-e49f17b02d28" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:22 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e8b1dac2-98cd-49ba-a486-0daf743ed6b5 tempest-ProjectReaderTests-1763016005 None] Create snapshot completed successfully Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a2d3a-3357-424b-9901-647ff9784b07]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-4eade9aa-39bf-4406-97b1-278010f281e7-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:22 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 Nov 06 21:58:22 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Lock "cinder-4eade9aa-39bf-4406-97b1-278010f281e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-4eade9aa-39bf-4406-97b1-278010f281e7" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-4eade9aa-39bf-4406-97b1-278010f281e7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Deleting offline snapshot 4eade9aa-39bf-4406-97b1-278010f281e7 of volume f08c91f7-cd86-43bc-9948-cf8b776cd6c1 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] snapshot_file for this snap is: volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e610b5e-89a1-4d92-83d3-598a3ead1cb3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:22 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 Nov 06 21:58:22 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:22 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28" returned: 0 in 0.383s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:22 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28 Nov 06 21:58:22 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:22 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7" returned: 0 in 0.382s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:22 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eed001b-c789-4d6f-acce-2e1ca651f43c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:23 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-29f2ef10-8da7-4570-b87a-e49f17b02d28" returned: 0 in 0.261s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-29f2ef10-8da7-4570-b87a-e49f17b02d28" released by "delete_volume" :: held 0.728s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Created reservations ['627072ee-9662-48bd-b46a-9194b748abc3', '5fa0e49c-0fd1-4d36-befb-0c588e73d583', '793e8ec3-81ee-4e1d-b918-041050402c2c', '0273aca2-7dc3-4a97-9818-25dbac71c0ea'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:23 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 Nov 06 21:58:23 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:23 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:23 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:23 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" returned: 0 in 0.399s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:23 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 Nov 06 21:58:23 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:23 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:23 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0f749476-1b7e-4351-8924-dac682dd8709 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-29f2ef10-8da7-4570-b87a-e49f17b02d28-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:23 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7" returned: 0 in 0.384s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:23 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7 Nov 06 21:58:23 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (470b5b1a-955d-4b51-87f5-da83d331fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fed489-c74e-4fb7-8f62-dd220e417d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0fed489-c74e-4fb7-8f62-dd220e417d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846894639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905901f5-9fad-431a-a9db-49c98d8936fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:24Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eff1f8b-13e9-48d2-952a-45695930a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eff1f8b-13e9-48d2-952a-45695930a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23aa39e-24f1-441c-a531-3818f2d91e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a23aa39e-24f1-441c-a531-3818f2d91e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905901f5-9fad-431a-a9db-49c98d8936fa', 'volume_name': 'volume-905901f5-9fad-431a-a9db-49c98d8936fa', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49733528-8593-4dd9-8270-45caa5831c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49733528-8593-4dd9-8270-45caa5831c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361980af-edca-4266-a2ff-65d1ac9f1e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:23 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Volume 905901f5-9fad-431a-a9db-49c98d8936fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905901f5-9fad-431a-a9db-49c98d8936fa', 'volume_size': 1} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846894639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905901f5-9fad-431a-a9db-49c98d8936fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:24Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Creating volume 905901f5-9fad-431a-a9db-49c98d8936fa {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:23 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:23 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:24 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa 1073741824 Nov 06 21:58:24 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:24 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1.4eade9aa-39bf-4406-97b1-278010f281e7" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-4eade9aa-39bf-4406-97b1-278010f281e7" released by "_delete_snapshot" :: held 1.544s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" released by "delete_snapshot" :: held 1.568s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Created reservations ['e9a308a9-02b4-4072-9ba3-8c8888dcce21', '409c3cda-1f86-4c72-96f7-0a383efa86ff', '65c44ace-0026-458f-a7cd-47c2249f6382', '6086584a-2427-466d-b901-0d3059c96980'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Delete snapshot completed successfully. Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f1ba01b0-9f83-4f73-97ea-516e44d3c16e tempest-ProjectReaderTests-1763016005 None] Lock "cinder-4eade9aa-39bf-4406-97b1-278010f281e7-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:24 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa 1073741824" returned: 0 in 0.436s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:24 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa Nov 06 21:58:24 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-f08c91f7-cd86-43bc-9948-cf8b776cd6c1-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:24 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa" returned: 0 in 0.257s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Lock "cinder-f08c91f7-cd86-43bc-9948-cf8b776cd6c1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361980af-edca-4266-a2ff-65d1ac9f1e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905901f5-9fad-431a-a9db-49c98d8936fa', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05114250-f8df-4979-8b0c-c179289f62b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:24 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Volume volume-905901f5-9fad-431a-a9db-49c98d8936fa (905901f5-9fad-431a-a9db-49c98d8936fa): created successfully Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05114250-f8df-4979-8b0c-c179289f62b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (470b5b1a-955d-4b51-87f5-da83d331fefc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:24 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8aef7b6b-77c6-47a0-8d57-bed16c66e4ca tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3c15a2-6c25-45a8-af0b-cddaf80f4b95]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:24 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:24 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 Nov 06 21:58:24 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot 46d9f652-2556-4ae2-ab16-802f25e9dad2 of volume 905901f5-9fad-431a-a9db-49c98d8936fa {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebebad4-d543-4a55-9a87-65a70d13f965]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:25 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa Nov 06 21:58:25 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:25 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" returned: 0 in 0.392s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:25 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1 Nov 06 21:58:25 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:25 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa" returned: 0 in 0.374s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:25 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" returned: 0 in 0.260s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:25 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 1G Nov 06 21:58:25 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-f08c91f7-cd86-43bc-9948-cf8b776cd6c1" released by "delete_volume" :: held 0.730s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Created reservations ['dec6715a-d8f3-4bb1-9945-a85d1e8e6673', 'e0ff2b5b-0be4-4ed2-9dcb-02091146d37e', 'f7b98a72-1fa2-4944-86d3-b87cc8c1ac8b', '9f709ce0-79cd-4ef0-8097-04c7f3962d2b'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:25 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:25 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:25 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.255s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:25 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Deleted volume successfully. Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a2bae88f-c2b1-4233-a3a4-da05d04533fe tempest-ProjectReaderTests-1763016005 None] Lock "cinder-f08c91f7-cd86-43bc-9948-cf8b776cd6c1-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:25 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 1G" returned: 0 in 0.462s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:25 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905901f5-9fad-431a-a9db-49c98d8936fa -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:25 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905901f5-9fad-431a-a9db-49c98d8936fa -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 Nov 06 21:58:25 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:26 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-905901f5-9fad-431a-a9db-49c98d8936fa -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2" returned: 0 in 0.312s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:26 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 is being set with open permissions: ugo+rw Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:26 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 Nov 06 21:58:26 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (cb7390e9-b004-442c-a1cf-487eef382155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db22573-bb61-43b6-ab82-1bda3d26787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9db22573-bb61-43b6-ab82-1bda3d26787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818556962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348dd405-c50b-41bc-8ef9-d84931c6de3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:26Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4774112e-4896-486e-a3ce-a8f0cad586bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4774112e-4896-486e-a3ce-a8f0cad586bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fa8791-506c-4565-8f1a-1f39f43fb816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fa8791-506c-4565-8f1a-1f39f43fb816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348dd405-c50b-41bc-8ef9-d84931c6de3e', 'volume_name': 'volume-348dd405-c50b-41bc-8ef9-d84931c6de3e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d44bd3c-836b-474b-aa06-156348c3e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d44bd3c-836b-474b-aa06-156348c3e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93beea2-d373-44d5-8ef4-136958d2b164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:26 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Volume 348dd405-c50b-41bc-8ef9-d84931c6de3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348dd405-c50b-41bc-8ef9-d84931c6de3e', 'volume_size': 1} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:26 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2" returned: 0 in 0.244s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:26 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.info Nov 06 21:58:26 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:26 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.info" returned: 0 in 0.260s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:26 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.info is being set with open permissions: ugo+rw Nov 06 21:58:26 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:26 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.info Nov 06 21:58:26 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:27 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.info" returned: 0 in 0.239s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1818556962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348dd405-c50b-41bc-8ef9-d84931c6de3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ef4151789645f8872265e046108601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:26Z,use_quota=True,user_id='b3ca0989ac714b0ba71d30b518375d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Creating volume 348dd405-c50b-41bc-8ef9-d84931c6de3e {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:27 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:27 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e 1073741824 Nov 06 21:58:27 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:27 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7c444b4f-18f6-4651-b3d5-047fbbc5de98 tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:58:27 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e 1073741824" returned: 0 in 0.411s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:27 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e Nov 06 21:58:27 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:27 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e" returned: 0 in 0.236s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93beea2-d373-44d5-8ef4-136958d2b164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348dd405-c50b-41bc-8ef9-d84931c6de3e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4568ff9-30f3-4be5-9cf5-166bfed88b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:27 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Volume volume-348dd405-c50b-41bc-8ef9-d84931c6de3e (348dd405-c50b-41bc-8ef9-d84931c6de3e): created successfully Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4568ff9-30f3-4be5-9cf5-166bfed88b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:27 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Flow 'volume_create_manager' (cb7390e9-b004-442c-a1cf-487eef382155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:27 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-22896b9a-e31d-4ac7-a33f-c4ef4e951a85 tempest-ProjectReaderTests-1763016005 None] Created volume successfully. Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-46d9f652-2556-4ae2-ab16-802f25e9dad2-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Lock "cinder-46d9f652-2556-4ae2-ab16-802f25e9dad2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-905901f5-9fad-431a-a9db-49c98d8936fa" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-905901f5-9fad-431a-a9db-49c98d8936fa" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-46d9f652-2556-4ae2-ab16-802f25e9dad2" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-46d9f652-2556-4ae2-ab16-802f25e9dad2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot 46d9f652-2556-4ae2-ab16-802f25e9dad2 of volume 905901f5-9fad-431a-a9db-49c98d8936fa {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdcea86-bf19-4546-9477-e56fd5531734]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:28 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 Nov 06 21:58:28 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Creating offline snapshot 97758019-8983-4f0f-ab3c-ce4df686bd85 of volume 348dd405-c50b-41bc-8ef9-d84931c6de3e {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0b2351-c62f-4679-b0ad-155e690ebac1]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:28 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2" returned: 0 in 0.395s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-905901f5-9fad-431a-a9db-49c98d8936fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f173d19-8a77-4466-a93d-5153794e1619]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:28 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:28 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e Nov 06 21:58:28 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:28 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa Nov 06 21:58:28 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:29 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e" returned: 0 in 0.369s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:29 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 1G Nov 06 21:58:29 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:29 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa" returned: 0 in 0.379s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:29 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 Nov 06 21:58:29 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:29 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 1G" returned: 0 in 0.406s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-348dd405-c50b-41bc-8ef9-d84931c6de3e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:29 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-348dd405-c50b-41bc-8ef9-d84931c6de3e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 Nov 06 21:58:29 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:29 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2" returned: 0 in 0.360s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:29 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2 Nov 06 21:58:29 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:29 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-348dd405-c50b-41bc-8ef9-d84931c6de3e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85" returned: 0 in 0.316s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:29 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 is being set with open permissions: ugo+rw Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:29 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa.46d9f652-2556-4ae2-ab16-802f25e9dad2" returned: 0 in 0.276s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:29 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 Nov 06 21:58:29 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-46d9f652-2556-4ae2-ab16-802f25e9dad2" released by "_delete_snapshot" :: held 1.526s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-905901f5-9fad-431a-a9db-49c98d8936fa" released by "delete_snapshot" :: held 1.547s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Created reservations ['e904c749-dfd1-4efe-b5ba-bb00c412b263', '797da84f-410a-4e36-b6a4-f287f2384407', 'e8e90587-1ff5-4c99-8b32-5ec454668c0e', 'e813abb2-38b1-4cf4-9dc2-6f805e58f8f8'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:29 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:58:29 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-0c81e66e-317b-4479-b1e1-a0a3a245a54f tempest-ProjectMemberTests-1193509755 None] Lock "cinder-46d9f652-2556-4ae2-ab16-802f25e9dad2-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:30 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85" returned: 0 in 0.252s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:30 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.info Nov 06 21:58:30 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:30 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.info" returned: 0 in 0.265s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:30 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.info is being set with open permissions: ugo+rw Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:30 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.info Nov 06 21:58:30 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-905901f5-9fad-431a-a9db-49c98d8936fa-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-905901f5-9fad-431a-a9db-49c98d8936fa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-905901f5-9fad-431a-a9db-49c98d8936fa" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-905901f5-9fad-431a-a9db-49c98d8936fa" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7d967f-2ef2-4e3e-b9b1-7baf41e1c85e]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:30 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.info" returned: 0 in 0.276s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.973s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:30 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-57860a17-6e9a-44d6-a967-a23fd381079e tempest-ProjectReaderTests-1763016005 None] Create snapshot completed successfully Nov 06 21:58:30 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa Nov 06 21:58:30 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-97758019-8983-4f0f-ab3c-ce4df686bd85-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Lock "cinder-97758019-8983-4f0f-ab3c-ce4df686bd85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-348dd405-c50b-41bc-8ef9-d84931c6de3e" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-348dd405-c50b-41bc-8ef9-d84931c6de3e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-97758019-8983-4f0f-ab3c-ce4df686bd85" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-97758019-8983-4f0f-ab3c-ce4df686bd85" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Deleting offline snapshot 97758019-8983-4f0f-ab3c-ce4df686bd85 of volume 348dd405-c50b-41bc-8ef9-d84931c6de3e {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] snapshot_file for this snap is: volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e6570-f83d-42d2-bed0-08026e49663b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:30 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa" returned: 0 in 0.401s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:30 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:30 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa Nov 06 21:58:30 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:30 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 Nov 06 21:58:30 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:31 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-905901f5-9fad-431a-a9db-49c98d8936fa" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-905901f5-9fad-431a-a9db-49c98d8936fa" released by "delete_volume" :: held 0.711s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:31 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85" returned: 0 in 0.382s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-348dd405-c50b-41bc-8ef9-d84931c6de3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Created reservations ['b88bb1d9-9083-4527-90b4-24e1437e51bd', '974435bb-4e79-480b-9e93-48c008993538', '83f188f4-2573-40e9-82e3-a1acbaa29405', 'f1bdd78f-68ca-4056-926c-f2c627c921dd'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53b7737-fe49-40e6-8981-f0b5ed0ec7ba]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:31 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:31 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:31 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e Nov 06 21:58:31 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:31 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.266s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:31 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-30670252-d285-4ff1-82ac-be9367d68e0c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-905901f5-9fad-431a-a9db-49c98d8936fa-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:31 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e" returned: 0 in 0.409s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:31 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:31 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 Nov 06 21:58:31 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:32 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85" returned: 0 in 0.372s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:32 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85 Nov 06 21:58:32 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (e3a2c399-8d74-4a42-99f0-62ded7ec8d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a8fdb6-06bb-428f-8ab6-61a7892d8e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a8fdb6-06bb-428f-8ab6-61a7892d8e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1525970802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b920940d-f1e7-4b19-bd04-9c7cc9f2ab48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:32Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85002dd-9d9e-4015-88d1-6080764fb344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85002dd-9d9e-4015-88d1-6080764fb344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9c4417-ccf0-48cd-9f99-7d1479b5f21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9c4417-ccf0-48cd-9f99-7d1479b5f21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b920940d-f1e7-4b19-bd04-9c7cc9f2ab48', 'volume_name': 'volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96d02bd-18fb-470f-be75-c21e84890fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96d02bd-18fb-470f-be75-c21e84890fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ae8f6c-a3e3-4196-9503-637bdcb9d830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Volume b920940d-f1e7-4b19-bd04-9c7cc9f2ab48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48', 'volume_size': 1} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1525970802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b920940d-f1e7-4b19-bd04-9c7cc9f2ab48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:32Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Creating volume b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:32 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:32 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 1073741824 Nov 06 21:58:32 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:32 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e.97758019-8983-4f0f-ab3c-ce4df686bd85" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-97758019-8983-4f0f-ab3c-ce4df686bd85" released by "_delete_snapshot" :: held 1.514s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-348dd405-c50b-41bc-8ef9-d84931c6de3e" released by "delete_snapshot" :: held 1.539s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Created reservations ['7485c538-2be8-443c-98d3-99c7b930e3b9', '1844a2a6-1fb8-409e-b475-910906775db1', 'c50fd634-2021-433a-961b-9b3e6b46c5c5', 'a653057f-9e90-4667-8a2b-0f4bb91199fc'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Delete snapshot completed successfully. Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-9d91fc37-c509-4c8b-a6fa-e80bfda17acb tempest-ProjectReaderTests-1763016005 None] Lock "cinder-97758019-8983-4f0f-ab3c-ce4df686bd85-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:32 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 1073741824" returned: 0 in 0.433s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:32 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 Nov 06 21:58:32 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:32 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" returned: 0 in 0.249s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ae8f6c-a3e3-4196-9503-637bdcb9d830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2749e12-5861-4ffc-8249-253d364ada41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:32 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Volume volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 (b920940d-f1e7-4b19-bd04-9c7cc9f2ab48): created successfully Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2749e12-5861-4ffc-8249-253d364ada41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (e3a2c399-8d74-4a42-99f0-62ded7ec8d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-348dd405-c50b-41bc-8ef9-d84931c6de3e-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:32 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fac21102-0167-41b9-b436-72377502b034 tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:58:32 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-348dd405-c50b-41bc-8ef9-d84931c6de3e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "cinder-quobyte-348dd405-c50b-41bc-8ef9-d84931c6de3e" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-348dd405-c50b-41bc-8ef9-d84931c6de3e" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe4ae41-f27d-42a8-acfb-bab6cec1c051]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:33 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e Nov 06 21:58:33 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot ce34cbb7-91c7-46fb-adf8-72c20b922b20 of volume b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dfec2f-c1c1-4ec9-9aa9-77a1a807fbc7]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:33 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 Nov 06 21:58:33 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:33 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e" returned: 0 in 0.386s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:33 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e Nov 06 21:58:33 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:33 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" returned: 0 in 0.387s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:33 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 1G Nov 06 21:58:33 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:33 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-348dd405-c50b-41bc-8ef9-d84931c6de3e" returned: 0 in 0.258s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-quobyte-348dd405-c50b-41bc-8ef9-d84931c6de3e" released by "delete_volume" :: held 0.714s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Created reservations ['eff684bc-a80c-48d7-ab8f-451cc983622a', 'd19d9ae4-7c35-4cb9-b1c9-4b2226714b91', '3db4071c-64c3-4453-a881-1cf072986844', 'f500424d-2f80-4956-abd8-cf923b07041c'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:33 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:33 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:33 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:34 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 1G" returned: 0 in 0.413s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:34 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:34 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.257s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:34 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:34 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Deleted volume successfully. Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1538d0d0-1471-49cd-8348-a95596db0ed4 tempest-ProjectReaderTests-1763016005 None] Lock "cinder-348dd405-c50b-41bc-8ef9-d84931c6de3e-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:34 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20" returned: 0 in 0.310s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:34 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 is being set with open permissions: ugo+rw Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:34 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 Nov 06 21:58:34 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:34 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20" returned: 0 in 0.256s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:34 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.info Nov 06 21:58:34 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:34 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.info" returned: 0 in 0.285s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:34 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.info is being set with open permissions: ugo+rw Nov 06 21:58:34 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:34 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.info Nov 06 21:58:34 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:35 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.info" returned: 0 in 0.280s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:35 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.034s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:35 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6402741c-4d32-4c38-987a-4a02be4a3d5b tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-ce34cbb7-91c7-46fb-adf8-72c20b922b20-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Lock "cinder-ce34cbb7-91c7-46fb-adf8-72c20b922b20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-ce34cbb7-91c7-46fb-adf8-72c20b922b20" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-ce34cbb7-91c7-46fb-adf8-72c20b922b20" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot ce34cbb7-91c7-46fb-adf8-72c20b922b20 of volume b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[50069535-065a-4831-a7ba-a88487b6a25c]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:36 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:36 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 Nov 06 21:58:36 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:37 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20" returned: 0 in 0.403s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:37 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:37 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3fa72e-bcf5-4ce6-a048-53b7eebd54d2]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:37 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 Nov 06 21:58:37 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:37 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" returned: 0 in 0.387s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:37 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 Nov 06 21:58:37 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:37 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20" returned: 0 in 0.374s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:37 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:37 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20 Nov 06 21:58:37 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:38 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48.ce34cbb7-91c7-46fb-adf8-72c20b922b20" returned: 0 in 0.256s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-ce34cbb7-91c7-46fb-adf8-72c20b922b20" released by "_delete_snapshot" :: held 1.522s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" released by "delete_snapshot" :: held 1.547s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Created reservations ['f0d7cec6-1796-4e23-9f8b-02fd26a580e1', 'fe5b0fb4-776d-405c-96f1-f2b1fc6864a3', 'd901c06d-6193-4560-8fff-7badaa4a4f02', '9dded225-c0c9-4fd3-aa7e-ce832418123f'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:38 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-36dcde68-722e-4505-97ca-4789d798ea8d tempest-ProjectMemberTests-1193509755 None] Lock "cinder-ce34cbb7-91c7-46fb-adf8-72c20b922b20-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" acquired by "delete_volume" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa86bb1-ab51-4237-beb1-5a3b66cfd89d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:38 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:39 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 Nov 06 21:58:39 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:39 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" returned: 0 in 0.382s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:39 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48 Nov 06 21:58:39 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:39 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" returned: 0 in 0.249s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48" released by "delete_volume" :: held 0.702s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Created reservations ['2851c4ad-e594-4c05-8a0d-2761f1c42f21', 'fcf401ae-9d4e-47b7-99c0-f91123ff6d65', '94dd79c8-0a5b-48db-a28d-207d12d2a89c', 'c304bd24-07c8-4573-a4e8-d2f4bd109134'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:39 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:39 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:39 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:39 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:39 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c9413ef7-3b56-4744-89ae-7cfc46ca5c61 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-b920940d-f1e7-4b19-bd04-9c7cc9f2ab48-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (c0688bdd-c7b4-4bf5-acab-d8506f961c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be16797-0efe-4e5e-9447-a9cf81353437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be16797-0efe-4e5e-9447-a9cf81353437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388551258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19dc156-9977-49a1-98bf-2350e6f7352b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:40Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3b655d-1df5-4b58-a8bf-b99c04576c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3b655d-1df5-4b58-a8bf-b99c04576c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a645f9-8feb-4daf-bb5d-cff8d9c88bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a645f9-8feb-4daf-bb5d-cff8d9c88bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19dc156-9977-49a1-98bf-2350e6f7352b', 'volume_name': 'volume-b19dc156-9977-49a1-98bf-2350e6f7352b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bffe82-48b7-4a7d-897f-c94f848d8780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bffe82-48b7-4a7d-897f-c94f848d8780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5e5319-97f9-43ae-b7de-a5519bf144c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:40 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Volume b19dc156-9977-49a1-98bf-2350e6f7352b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19dc156-9977-49a1-98bf-2350e6f7352b', 'volume_size': 1} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-388551258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19dc156-9977-49a1-98bf-2350e6f7352b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:40Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Creating volume b19dc156-9977-49a1-98bf-2350e6f7352b {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:40 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:40 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b 1073741824 Nov 06 21:58:40 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:40 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:40 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b 1073741824" returned: 0 in 0.462s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:41 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b Nov 06 21:58:41 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:41 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b" returned: 0 in 0.249s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5e5319-97f9-43ae-b7de-a5519bf144c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19dc156-9977-49a1-98bf-2350e6f7352b', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb05e1b-1422-4c00-9c27-afe0e2571daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:41 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Volume volume-b19dc156-9977-49a1-98bf-2350e6f7352b (b19dc156-9977-49a1-98bf-2350e6f7352b): created successfully Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb05e1b-1422-4c00-9c27-afe0e2571daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (c0688bdd-c7b4-4bf5-acab-d8506f961c8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:41 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-8d63f8a7-44d5-4bc7-8b22-f794556f4d17 tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot 914cefe2-92fd-4a48-a41f-7ac4accbc5b7 of volume b19dc156-9977-49a1-98bf-2350e6f7352b {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f403f9b6-d30a-4f91-bcbb-7047d21b1a2d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:41 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:41 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b Nov 06 21:58:41 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:42 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b" returned: 0 in 0.381s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:42 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 1G Nov 06 21:58:42 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:42 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 1G" returned: 0 in 0.441s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19dc156-9977-49a1-98bf-2350e6f7352b -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:42 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19dc156-9977-49a1-98bf-2350e6f7352b -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 Nov 06 21:58:42 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:42 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b19dc156-9977-49a1-98bf-2350e6f7352b -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7" returned: 0 in 0.306s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:42 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 is being set with open permissions: ugo+rw Nov 06 21:58:42 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:42 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 Nov 06 21:58:42 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:43 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7" returned: 0 in 0.264s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:43 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.info Nov 06 21:58:43 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:43 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.info" returned: 0 in 0.262s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:43 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.info is being set with open permissions: ugo+rw Nov 06 21:58:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:43 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.info Nov 06 21:58:43 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:43 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.info" returned: 0 in 0.258s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:43 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:43 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dc5a9ae5-2c94-45af-b77e-d18d48f93576 tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-914cefe2-92fd-4a48-a41f-7ac4accbc5b7-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-914cefe2-92fd-4a48-a41f-7ac4accbc5b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-b19dc156-9977-49a1-98bf-2350e6f7352b" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-b19dc156-9977-49a1-98bf-2350e6f7352b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-914cefe2-92fd-4a48-a41f-7ac4accbc5b7" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-914cefe2-92fd-4a48-a41f-7ac4accbc5b7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot 914cefe2-92fd-4a48-a41f-7ac4accbc5b7 of volume b19dc156-9977-49a1-98bf-2350e6f7352b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4ca45c-92e5-41ec-8333-6a46a29afc13]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:44 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:44 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 Nov 06 21:58:44 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:45 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7" returned: 0 in 0.374s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b19dc156-9977-49a1-98bf-2350e6f7352b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:45 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ba02c2-7cf5-4781-a3b0-3295593145d5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:45 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b Nov 06 21:58:45 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:45 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b" returned: 0 in 0.373s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:45 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 Nov 06 21:58:45 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:46 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7" returned: 0 in 0.354s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:46 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7 Nov 06 21:58:46 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:46 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b.914cefe2-92fd-4a48-a41f-7ac4accbc5b7" returned: 0 in 0.257s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-914cefe2-92fd-4a48-a41f-7ac4accbc5b7" released by "_delete_snapshot" :: held 1.469s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-b19dc156-9977-49a1-98bf-2350e6f7352b" released by "delete_snapshot" :: held 1.490s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Created reservations ['c4752e36-b9f5-4137-94e4-d805b3e107ca', '490d55af-01ea-458a-a76c-32f27d9dc2c7', '122b19ca-f025-410e-b05f-767b6ef86e83', 'a7f0d1c9-099b-4f9c-bca1-ec90fb4b3d15'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:46 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-f5a956fc-2923-43c2-a908-ebe7941aa970 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-914cefe2-92fd-4a48-a41f-7ac4accbc5b7-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Flow 'volume_create_manager' (bbf475b0-191d-4c73-9bfe-6b4cbd640302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a0945d-d257-4bfa-8c59-d3aa1e4df599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a0945d-d257-4bfa-8c59-d3aa1e4df599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005712091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eceb1c-508f-47d8-99c6-2617e124768f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1b8e63acc497fac26353bd513825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:46Z,use_quota=True,user_id='d2e01a81d89347ec92c3d2ae516b2e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e16d260-a60b-44c7-a95c-d51a8b0cfa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e16d260-a60b-44c7-a95c-d51a8b0cfa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a05e25-11d5-43b1-9549-2891b010aebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a05e25-11d5-43b1-9549-2891b010aebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6eceb1c-508f-47d8-99c6-2617e124768f', 'volume_name': 'volume-d6eceb1c-508f-47d8-99c6-2617e124768f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b64f2a8-2067-42df-ae7a-766e295cb8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b64f2a8-2067-42df-ae7a-766e295cb8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673a77f2-6342-46de-90f1-ca7f9d2d2c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:46 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Volume d6eceb1c-508f-47d8-99c6-2617e124768f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6eceb1c-508f-47d8-99c6-2617e124768f', 'volume_size': 1} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2005712091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6eceb1c-508f-47d8-99c6-2617e124768f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1b8e63acc497fac26353bd513825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:46Z,use_quota=True,user_id='d2e01a81d89347ec92c3d2ae516b2e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Creating volume d6eceb1c-508f-47d8-99c6-2617e124768f {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:46 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:46 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f 1073741824 Nov 06 21:58:46 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-b19dc156-9977-49a1-98bf-2350e6f7352b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:46 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-b19dc156-9977-49a1-98bf-2350e6f7352b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-b19dc156-9977-49a1-98bf-2350e6f7352b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-b19dc156-9977-49a1-98bf-2350e6f7352b" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:47 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f 1073741824" returned: 0 in 0.464s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab8b4eb-f298-4f48-8872-6244bb077f02]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:47 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f Nov 06 21:58:47 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:47 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b Nov 06 21:58:47 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:47 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f" returned: 0 in 0.234s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673a77f2-6342-46de-90f1-ca7f9d2d2c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6eceb1c-508f-47d8-99c6-2617e124768f', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a885d2-c8b4-4b2e-b95e-b01e8d73c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:47 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Volume volume-d6eceb1c-508f-47d8-99c6-2617e124768f (d6eceb1c-508f-47d8-99c6-2617e124768f): created successfully Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a885d2-c8b4-4b2e-b95e-b01e8d73c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Flow 'volume_create_manager' (bbf475b0-191d-4c73-9bfe-6b4cbd640302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:47 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-f97baca1-b8bb-41ef-aa58-ee0163fc9148 tempest-ProjectReaderTests-101495879 None] Created volume successfully. Nov 06 21:58:47 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b" returned: 0 in 0.364s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:47 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b Nov 06 21:58:47 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:47 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-b19dc156-9977-49a1-98bf-2350e6f7352b" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Acquiring lock "cinder-d6eceb1c-508f-47d8-99c6-2617e124768f-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-b19dc156-9977-49a1-98bf-2350e6f7352b" released by "delete_volume" :: held 0.690s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Lock "cinder-d6eceb1c-508f-47d8-99c6-2617e124768f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Acquiring lock "cinder-quobyte-d6eceb1c-508f-47d8-99c6-2617e124768f" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Created reservations ['ea43ffeb-86ff-48b3-a562-8be2539c8bf9', 'f6cca242-f571-4c90-a653-ae8b118fcb41', 'a9d55175-7139-457f-ac4d-a8dca30432e3', 'e944d7ed-e279-49e3-ab5f-5efab229dea1'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Lock "cinder-quobyte-d6eceb1c-508f-47d8-99c6-2617e124768f" acquired by "delete_volume" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[04877c2c-78c3-4511-9aae-18a5d5f3dba3]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:47 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:47 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:47 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f Nov 06 21:58:47 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:48 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-a753e966-1a9b-4c5e-ab68-842e41eb1170 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-b19dc156-9977-49a1-98bf-2350e6f7352b-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:48 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f" returned: 0 in 0.396s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:48 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f Nov 06 21:58:48 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:48 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-d6eceb1c-508f-47d8-99c6-2617e124768f" returned: 0 in 0.266s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Lock "cinder-quobyte-d6eceb1c-508f-47d8-99c6-2617e124768f" released by "delete_volume" :: held 0.710s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Created reservations ['260a1f12-6b4f-4d9e-8397-57ca6151ba3b', '8a6728dc-729a-494e-8ef4-6c82e3fdf00e', '408ee337-50cb-45ce-8875-9e1f14afdbb8', '996cfb3a-747b-4322-a030-5f875185b2d2'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (25d52b17-5f33-41cc-a10f-a447345e3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c33e316-f209-4b3a-877c-9488ef0e6108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c33e316-f209-4b3a-877c-9488ef0e6108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650554536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b022edc-3d2e-4f5e-a07f-627e288921b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:49Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae36e4e7-6018-4018-8262-4f7f880f4d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae36e4e7-6018-4018-8262-4f7f880f4d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19972c24-cb5e-4c59-be21-f08784213a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19972c24-cb5e-4c59-be21-f08784213a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b022edc-3d2e-4f5e-a07f-627e288921b0', 'volume_name': 'volume-3b022edc-3d2e-4f5e-a07f-627e288921b0', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e0a5a3-5736-4ee2-9a2f-d14ed591be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e0a5a3-5736-4ee2-9a2f-d14ed591be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a30a918-523f-4116-bbfc-eada9ec227e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:48 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Volume 3b022edc-3d2e-4f5e-a07f-627e288921b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b022edc-3d2e-4f5e-a07f-627e288921b0', 'volume_size': 1} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650554536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b022edc-3d2e-4f5e-a07f-627e288921b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:49Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Creating volume 3b022edc-3d2e-4f5e-a07f-627e288921b0 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:48 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:48 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 1073741824 Nov 06 21:58:48 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:48 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:48 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:48 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:48 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Deleted volume successfully. Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6f639ddf-a502-4018-b142-8b27e58b8898 tempest-ProjectReaderTests-101495879 None] Lock "cinder-d6eceb1c-508f-47d8-99c6-2617e124768f-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:49 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 1073741824" returned: 0 in 0.488s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:49 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 Nov 06 21:58:49 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Flow 'volume_create_manager' (87f106ad-b13a-4cd4-8915-94190edabddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594a3ca0-be0a-45aa-8401-8172f0588896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594a3ca0-be0a-45aa-8401-8172f0588896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789914288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdb2696-f334-41ca-b0b3-42575d417950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1b8e63acc497fac26353bd513825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:49Z,use_quota=True,user_id='d2e01a81d89347ec92c3d2ae516b2e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a008f13-fd10-4f7c-8682-bceea1bf9a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a008f13-fd10-4f7c-8682-bceea1bf9a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c32464-445b-4208-8fc5-1efa7e0c205f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c32464-445b-4208-8fc5-1efa7e0c205f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cdb2696-f334-41ca-b0b3-42575d417950', 'volume_name': 'volume-7cdb2696-f334-41ca-b0b3-42575d417950', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57acd0d-c7fb-4013-81ac-241d876c13d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57acd0d-c7fb-4013-81ac-241d876c13d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a6cb19-76c0-42ab-a6d0-98aec8aec7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:49 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Volume 7cdb2696-f334-41ca-b0b3-42575d417950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cdb2696-f334-41ca-b0b3-42575d417950', 'volume_size': 1} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:49 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0" returned: 0 in 0.262s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.072s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789914288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cdb2696-f334-41ca-b0b3-42575d417950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1b8e63acc497fac26353bd513825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:49Z,use_quota=True,user_id='d2e01a81d89347ec92c3d2ae516b2e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Creating volume 7cdb2696-f334-41ca-b0b3-42575d417950 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:49 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:49 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 1073741824 Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a30a918-523f-4116-bbfc-eada9ec227e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b022edc-3d2e-4f5e-a07f-627e288921b0', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:49 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cebf15-588a-4b7d-94f0-b67cd741b0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:49 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Volume volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 (3b022edc-3d2e-4f5e-a07f-627e288921b0): created successfully Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4cebf15-588a-4b7d-94f0-b67cd741b0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (25d52b17-5f33-41cc-a10f-a447345e3313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:49 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c825ca07-adcd-4242-9b91-21dad1485d2b tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:58:49 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 1073741824" returned: 0 in 0.401s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:49 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 Nov 06 21:58:49 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:50 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a6cb19-76c0-42ab-a6d0-98aec8aec7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cdb2696-f334-41ca-b0b3-42575d417950', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846d73ca-459d-464b-b5df-2829efad8035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:50 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Volume volume-7cdb2696-f334-41ca-b0b3-42575d417950 (7cdb2696-f334-41ca-b0b3-42575d417950): created successfully Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846d73ca-459d-464b-b5df-2829efad8035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Flow 'volume_create_manager' (87f106ad-b13a-4cd4-8915-94190edabddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:50 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-3a648fb0-b297-4a6c-bca8-b5c64a96fc8f tempest-ProjectReaderTests-101495879 None] Created volume successfully. Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Acquiring lock "cinder-7cdb2696-f334-41ca-b0b3-42575d417950-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Lock "cinder-7cdb2696-f334-41ca-b0b3-42575d417950-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Acquiring lock "cinder-quobyte-7cdb2696-f334-41ca-b0b3-42575d417950" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Lock "cinder-quobyte-7cdb2696-f334-41ca-b0b3-42575d417950" acquired by "delete_volume" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1197df45-226b-4e9c-8d4d-daf5ceb55295]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:50 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 Nov 06 21:58:50 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot c4dc4d85-540f-43ab-b163-80e699255ab5 of volume 3b022edc-3d2e-4f5e-a07f-627e288921b0 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[457588f0-bf05-4cfa-a711-17af0f25c248]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:50 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950" returned: 0 in 0.387s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:50 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:50 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950 Nov 06 21:58:50 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:50 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 Nov 06 21:58:50 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:51 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-7cdb2696-f334-41ca-b0b3-42575d417950" returned: 0 in 0.256s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Lock "cinder-quobyte-7cdb2696-f334-41ca-b0b3-42575d417950" released by "delete_volume" :: held 0.684s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Created reservations ['8a455f56-986c-4056-bc08-ebba08585388', '75e9b1c2-f00d-46a6-9d53-a05755cd6647', 'f860e8c4-c611-474d-9a2c-2d313b703b10', 'd02f0131-7cfc-4b69-b75d-522998e33ce1'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:51 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0" returned: 0 in 0.374s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:51 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 1G Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:51 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:51 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:51 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:51 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.263s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:51 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Deleted volume successfully. Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-dd89ac16-315f-47c0-99ef-8fd699674afe tempest-ProjectReaderTests-101495879 None] Lock "cinder-7cdb2696-f334-41ca-b0b3-42575d417950-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:51 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 1G" returned: 0 in 0.463s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:51 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 Nov 06 21:58:51 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:51 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:51 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 is being set with open permissions: ugo+rw Nov 06 21:58:51 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:52 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 Nov 06 21:58:52 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Flow 'volume_create_manager' (149e1450-2ff3-41fd-a205-a8dbbf7d3d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe02624b-beb8-4112-9b9d-a70f33104476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe02624b-beb8-4112-9b9d-a70f33104476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628454044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62613fa8-2374-4057-bf54-9d0a35864c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1b8e63acc497fac26353bd513825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:52Z,use_quota=True,user_id='d2e01a81d89347ec92c3d2ae516b2e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cd0b4e-78e2-4088-bff9-8874d7d9f50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cd0b4e-78e2-4088-bff9-8874d7d9f50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c501b4-e36b-451f-8f17-b90ac140d5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c501b4-e36b-451f-8f17-b90ac140d5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62613fa8-2374-4057-bf54-9d0a35864c7c', 'volume_name': 'volume-62613fa8-2374-4057-bf54-9d0a35864c7c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e48bec3-2d92-4da5-a1fa-97f680271f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e48bec3-2d92-4da5-a1fa-97f680271f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5f6492-97d7-4a9e-9491-299ff16068b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:52 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Volume 62613fa8-2374-4057-bf54-9d0a35864c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62613fa8-2374-4057-bf54-9d0a35864c7c', 'volume_size': 1} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:52 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5" returned: 0 in 0.239s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:52 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.info Nov 06 21:58:52 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:52 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.info" returned: 0 in 0.257s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:52 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.info is being set with open permissions: ugo+rw Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:52 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.info Nov 06 21:58:52 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:52 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.info" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628454044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62613fa8-2374-4057-bf54-9d0a35864c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1b8e63acc497fac26353bd513825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:52Z,use_quota=True,user_id='d2e01a81d89347ec92c3d2ae516b2e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Creating volume 62613fa8-2374-4057-bf54-9d0a35864c7c {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:52 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:52 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c 1073741824 Nov 06 21:58:52 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:52 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-a5e45768-e1c7-4c49-b78d-12f425c523d4 tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-c4dc4d85-540f-43ab-b163-80e699255ab5-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-c4dc4d85-540f-43ab-b163-80e699255ab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-3b022edc-3d2e-4f5e-a07f-627e288921b0" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-3b022edc-3d2e-4f5e-a07f-627e288921b0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:52 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-c4dc4d85-540f-43ab-b163-80e699255ab5" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-c4dc4d85-540f-43ab-b163-80e699255ab5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot c4dc4d85-540f-43ab-b163-80e699255ab5 of volume 3b022edc-3d2e-4f5e-a07f-627e288921b0 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1744120-c813-415b-8741-a0b348402a62]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:53 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 Nov 06 21:58:53 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:53 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c 1073741824" returned: 0 in 0.440s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:53 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c Nov 06 21:58:53 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:53 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5" returned: 0 in 0.368s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b022edc-3d2e-4f5e-a07f-627e288921b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cfdb93-e652-45b9-98b8-edaa42059b55]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:53 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c" returned: 0 in 0.270s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5f6492-97d7-4a9e-9491-299ff16068b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62613fa8-2374-4057-bf54-9d0a35864c7c', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3bd994-888c-4577-a1aa-a4cdbf86a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:53 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Volume volume-62613fa8-2374-4057-bf54-9d0a35864c7c (62613fa8-2374-4057-bf54-9d0a35864c7c): created successfully Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3bd994-888c-4577-a1aa-a4cdbf86a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Flow 'volume_create_manager' (149e1450-2ff3-41fd-a205-a8dbbf7d3d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:53 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 Nov 06 21:58:53 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:53 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-7b9031b7-b682-4f8f-92f2-697a407125a9 tempest-ProjectReaderTests-101495879 None] Created volume successfully. Nov 06 21:58:53 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0" returned: 0 in 0.366s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:53 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:53 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 Nov 06 21:58:53 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:54 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Acquiring lock "cinder-62613fa8-2374-4057-bf54-9d0a35864c7c-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Lock "cinder-62613fa8-2374-4057-bf54-9d0a35864c7c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:54 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5 Nov 06 21:58:54 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Acquiring lock "cinder-quobyte-62613fa8-2374-4057-bf54-9d0a35864c7c" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Lock "cinder-quobyte-62613fa8-2374-4057-bf54-9d0a35864c7c" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[00978291-4bce-4b4b-89bb-b2bc8918654a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:54 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c Nov 06 21:58:54 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:54 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0.c4dc4d85-540f-43ab-b163-80e699255ab5" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-c4dc4d85-540f-43ab-b163-80e699255ab5" released by "_delete_snapshot" :: held 1.464s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-3b022edc-3d2e-4f5e-a07f-627e288921b0" released by "delete_snapshot" :: held 1.489s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Created reservations ['440cdb13-b6de-4b16-886b-95ca7d8777b2', '8c7e9df0-ccce-4dc1-950e-6ad1247f9054', '450b7de6-caff-4288-a52c-21b7d9a2d2a1', '8f7bede3-ecc1-4b86-8b0e-e17c3c3160b0'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:54 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-820ba2db-2fe4-4588-937f-010f68464f19 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-c4dc4d85-540f-43ab-b163-80e699255ab5-delete_snapshot" released by "delete_snapshot" :: held 1.617s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:54 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c" returned: 0 in 0.384s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:54 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c Nov 06 21:58:54 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:54 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-62613fa8-2374-4057-bf54-9d0a35864c7c" returned: 0 in 0.250s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Lock "cinder-quobyte-62613fa8-2374-4057-bf54-9d0a35864c7c" released by "delete_volume" :: held 0.682s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:54 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Created reservations ['cdbf7fe1-5386-40ec-b141-5204c9a171ae', 'b7252773-e655-442d-8ffd-60bf1ca7ba82', '64e2972f-6854-4dcf-ad1a-e030e1b86f1f', '35b2abdd-e5d6-4d3f-ab5b-59e416a011e3'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:55 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:55 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-3b022edc-3d2e-4f5e-a07f-627e288921b0-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Lock "cinder-3b022edc-3d2e-4f5e-a07f-627e288921b0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-3b022edc-3d2e-4f5e-a07f-627e288921b0" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-3b022edc-3d2e-4f5e-a07f-627e288921b0" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f126c3-898b-4023-9836-25159dc87159]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:55 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.261s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:55 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Deleted volume successfully. Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-ef712a3d-b173-4f37-8aaa-8bebc0b88b80 tempest-ProjectReaderTests-101495879 None] Lock "cinder-62613fa8-2374-4057-bf54-9d0a35864c7c-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:55 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 Nov 06 21:58:55 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:55 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0" returned: 0 in 0.402s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:55 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0 Nov 06 21:58:55 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Flow 'volume_create_manager' (1f6649e4-aa1d-47c6-a5af-5a2c75edd892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1d8f09-a3a5-476c-a1d6-fa2d1df255c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1d8f09-a3a5-476c-a1d6-fa2d1df255c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063943665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbfb22e-d049-4718-b6e3-755e4e57cf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1b8e63acc497fac26353bd513825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:56Z,use_quota=True,user_id='d2e01a81d89347ec92c3d2ae516b2e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e35481-3297-4aff-a582-9168635203a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e35481-3297-4aff-a582-9168635203a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17552eec-8937-48a2-a2cb-3e1846e3f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17552eec-8937-48a2-a2cb-3e1846e3f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbfb22e-d049-4718-b6e3-755e4e57cf42', 'volume_name': 'volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a6ad53-d41c-4294-8467-534c00f3f1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a6ad53-d41c-4294-8467-534c00f3f1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c48ca04-4bf8-4dcd-be5d-5dd5b03d156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:55 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Volume 1fbfb22e-d049-4718-b6e3-755e4e57cf42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42', 'volume_size': 1} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1063943665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbfb22e-d049-4718-b6e3-755e4e57cf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37e1b8e63acc497fac26353bd513825a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:56Z,use_quota=True,user_id='d2e01a81d89347ec92c3d2ae516b2e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Creating volume 1fbfb22e-d049-4718-b6e3-755e4e57cf42 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:55 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:55 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:55 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 1073741824 Nov 06 21:58:55 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-3b022edc-3d2e-4f5e-a07f-627e288921b0" returned: 0 in 0.252s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-3b022edc-3d2e-4f5e-a07f-627e288921b0" released by "delete_volume" :: held 0.740s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:55 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Created reservations ['6e56ece3-d727-4408-b547-eba814fb7db7', '9b6447c7-2eeb-4d90-8479-4a481d2a0d43', '41ad7cd4-7ded-458c-8d2a-c9b90ec0addb', 'f7184a3f-7744-436e-ad76-81970497e6fc'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:56 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:56 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:56 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:56 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.277s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 1073741824" returned: 0 in 0.448s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-676acc02-988f-48a9-a9d1-8dd3f141699b tempest-ProjectMemberTests-1193509755 None] Lock "cinder-3b022edc-3d2e-4f5e-a07f-627e288921b0-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:56 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 Nov 06 21:58:56 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:56 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42" returned: 0 in 0.271s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c48ca04-4bf8-4dcd-be5d-5dd5b03d156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a562ac4-e21d-451c-9928-bd2320646f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:56 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Volume volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 (1fbfb22e-d049-4718-b6e3-755e4e57cf42): created successfully Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a562ac4-e21d-451c-9928-bd2320646f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Flow 'volume_create_manager' (1f6649e4-aa1d-47c6-a5af-5a2c75edd892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-152c135e-2632-42b5-ac40-144ed9e80dec tempest-ProjectReaderTests-101495879 None] Created volume successfully. Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (40f57986-c3f6-4a8a-b8d8-d86c99e3e134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07aaa6f8-bbde-4e8c-84d4-67f4ed50c673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07aaa6f8-bbde-4e8c-84d4-67f4ed50c673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305128533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920ad838-93b2-4a19-ad50-14679d1e6d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:57Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4a640e-1708-46a3-8b64-1073a29cad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4a640e-1708-46a3-8b64-1073a29cad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac86d99-7e2e-40a1-8d15-83faf93e22b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac86d99-7e2e-40a1-8d15-83faf93e22b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920ad838-93b2-4a19-ad50-14679d1e6d23', 'volume_name': 'volume-920ad838-93b2-4a19-ad50-14679d1e6d23', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbb6405-d7e5-4501-a09b-39b29ada36aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfbb6405-d7e5-4501-a09b-39b29ada36aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e0f0a-b1e9-4bd3-ab31-2bdba9c63602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:56 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Volume 920ad838-93b2-4a19-ad50-14679d1e6d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920ad838-93b2-4a19-ad50-14679d1e6d23', 'volume_size': 1} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305128533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920ad838-93b2-4a19-ad50-14679d1e6d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:58:57Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Creating volume 920ad838-93b2-4a19-ad50-14679d1e6d23 {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:58:56 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:58:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:56 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 1073741824 Nov 06 21:58:56 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:57 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 1073741824" returned: 0 in 0.407s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:57 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 Nov 06 21:58:57 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:57 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979e0f0a-b1e9-4bd3-ab31-2bdba9c63602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920ad838-93b2-4a19-ad50-14679d1e6d23', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a446ad60-d8a8-4f2c-ba26-fa2c4304e6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:58:57 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Volume volume-920ad838-93b2-4a19-ad50-14679d1e6d23 (920ad838-93b2-4a19-ad50-14679d1e6d23): created successfully Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a446ad60-d8a8-4f2c-ba26-fa2c4304e6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (40f57986-c3f6-4a8a-b8d8-d86c99e3e134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:58:57 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-57b8e4e4-4bf4-4ec3-8597-87672b845d4a tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Acquiring lock "cinder-1fbfb22e-d049-4718-b6e3-755e4e57cf42-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Lock "cinder-1fbfb22e-d049-4718-b6e3-755e4e57cf42-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Acquiring lock "cinder-quobyte-1fbfb22e-d049-4718-b6e3-755e4e57cf42" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot 3ffb9fad-3375-46d4-8962-0fb1af4149a8 of volume 920ad838-93b2-4a19-ad50-14679d1e6d23 {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Lock "cinder-quobyte-1fbfb22e-d049-4718-b6e3-755e4e57cf42" acquired by "delete_volume" :: waited 0.037s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eac427a-4b43-49e1-b06c-f6235e1166bc]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff2892-3f6e-47a3-9497-c7203c350032]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:58 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 Nov 06 21:58:58 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:58 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 Nov 06 21:58:58 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:58 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23" returned: 0 in 0.368s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:58 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42" returned: 0 in 0.380s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:58 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 1G Nov 06 21:58:58 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:58 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42 Nov 06 21:58:58 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:58 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-1fbfb22e-d049-4718-b6e3-755e4e57cf42" returned: 0 in 0.269s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Lock "cinder-quobyte-1fbfb22e-d049-4718-b6e3-755e4e57cf42" released by "delete_volume" :: held 0.693s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Created reservations ['5699b150-f3fe-4a8f-a517-6a028d953725', '51c72495-fef7-4637-865e-10e569e9112f', 'acbeacc8-f1ce-4dc7-98a4-5c79b3788df9', '023afda9-1caf-481d-a2e8-8e425cdad5ab'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:58 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:58 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:58 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 1G" returned: 0 in 0.422s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920ad838-93b2-4a19-ad50-14679d1e6d23 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:58 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920ad838-93b2-4a19-ad50-14679d1e6d23 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 Nov 06 21:58:58 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:58 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:58:58 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:59 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.282s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:58:59 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.264s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:59 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920ad838-93b2-4a19-ad50-14679d1e6d23 -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8" returned: 0 in 0.328s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:59 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 is being set with open permissions: ugo+rw Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:59 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Deleted volume successfully. Nov 06 21:58:59 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 Nov 06 21:58:59 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-63a8346d-aff3-4176-bf85-1c272cc146cd tempest-ProjectReaderTests-101495879 None] Lock "cinder-1fbfb22e-d049-4718-b6e3-755e4e57cf42-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:58:59 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8" returned: 0 in 0.256s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:59 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.info Nov 06 21:58:59 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:59 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.info" returned: 0 in 0.264s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:59 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.info is being set with open permissions: ugo+rw Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:58:59 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.info Nov 06 21:58:59 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:58:59 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.info" returned: 0 in 0.254s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:58:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:58:59 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4874ba9c-611c-4db9-aa6c-42c8f97f1228 tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-3ffb9fad-3375-46d4-8962-0fb1af4149a8-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-3ffb9fad-3375-46d4-8962-0fb1af4149a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-920ad838-93b2-4a19-ad50-14679d1e6d23" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-920ad838-93b2-4a19-ad50-14679d1e6d23" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-3ffb9fad-3375-46d4-8962-0fb1af4149a8" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-3ffb9fad-3375-46d4-8962-0fb1af4149a8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot 3ffb9fad-3375-46d4-8962-0fb1af4149a8 of volume 920ad838-93b2-4a19-ad50-14679d1e6d23 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[016b878a-7517-4bec-b388-1ad9d79be5bb]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:00 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 Nov 06 21:59:00 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:00 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8" returned: 0 in 0.394s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-920ad838-93b2-4a19-ad50-14679d1e6d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bb0de1-be35-47af-bbcd-b4efd99a2630]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:00 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 Nov 06 21:59:00 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:01 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23" returned: 0 in 0.376s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:01 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 Nov 06 21:59:01 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:01 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8" returned: 0 in 0.310s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:01 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8 Nov 06 21:59:01 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:01 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23.3ffb9fad-3375-46d4-8962-0fb1af4149a8" returned: 0 in 0.252s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-3ffb9fad-3375-46d4-8962-0fb1af4149a8" released by "_delete_snapshot" :: held 1.447s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-920ad838-93b2-4a19-ad50-14679d1e6d23" released by "delete_snapshot" :: held 1.472s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Created reservations ['61f3a970-dbb4-44ff-875a-69a663641c0f', 'f537c4d4-15ad-487e-a29b-1b5b5b879b71', '6e8e8dbf-2d64-43b6-afdd-efa39e353e15', '0608cf0b-6948-4e00-b8b9-5a38fbe3de62'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:59:01 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:59:01 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-6144ca77-8c5c-4368-9421-2d3410611d1c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-3ffb9fad-3375-46d4-8962-0fb1af4149a8-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-920ad838-93b2-4a19-ad50-14679d1e6d23-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-920ad838-93b2-4a19-ad50-14679d1e6d23-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-920ad838-93b2-4a19-ad50-14679d1e6d23" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-920ad838-93b2-4a19-ad50-14679d1e6d23" acquired by "delete_volume" :: waited 0.015s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[22486d4d-d75a-4b4b-b5b2-2fdaf0279dfd]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:02 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 Nov 06 21:59:02 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:02 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23" returned: 0 in 0.364s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:02 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23 Nov 06 21:59:02 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:02 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:02 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-920ad838-93b2-4a19-ad50-14679d1e6d23" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-920ad838-93b2-4a19-ad50-14679d1e6d23" released by "delete_volume" :: held 0.668s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Created reservations ['57792e53-3986-407c-b48b-c7f5716aaf50', 'e0187d1c-2239-4875-9135-df794fbc4dac', '78eb07fc-d38c-4124-9544-eda99e8f9e39', '4aaef10c-7709-4ddb-b55b-69184428dc07'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:03 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:59:03 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:03 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.236s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:59:03 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-4acb2369-a4cb-4f1e-9931-27e2c5e2fb14 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-920ad838-93b2-4a19-ad50-14679d1e6d23-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (7a1967d7-b217-4e41-8e6c-38dc8412541b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32daf925-60d6-4fb8-a5b5-6c88b0bdcf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32daf925-60d6-4fb8-a5b5-6c88b0bdcf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018186453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e92287-1672-4865-b4d0-c3aa6748a34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:59:04Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313502e9-7a10-4c30-829a-bccded256df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313502e9-7a10-4c30-829a-bccded256df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec0acbe-1925-4f17-bca4-c666d31ff5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec0acbe-1925-4f17-bca4-c666d31ff5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4e92287-1672-4865-b4d0-c3aa6748a34d', 'volume_name': 'volume-e4e92287-1672-4865-b4d0-c3aa6748a34d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0dd8da-ddba-427c-9461-79bd1dd06e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae0dd8da-ddba-427c-9461-79bd1dd06e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6997e2-98c0-4c3e-ae63-9f348404570b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:03 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Volume e4e92287-1672-4865-b4d0-c3aa6748a34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4e92287-1672-4865-b4d0-c3aa6748a34d', 'volume_size': 1} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1018186453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4e92287-1672-4865-b4d0-c3aa6748a34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:59:04Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Creating volume e4e92287-1672-4865-b4d0-c3aa6748a34d {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:59:03 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:59:03 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:03 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d 1073741824 Nov 06 21:59:03 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:04 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d 1073741824" returned: 0 in 0.406s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:04 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d Nov 06 21:59:04 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:04 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d" returned: 0 in 0.241s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b6997e2-98c0-4c3e-ae63-9f348404570b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4e92287-1672-4865-b4d0-c3aa6748a34d', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9a6f22-4968-4638-b122-9cfddf0e0909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=232,cinder:SELECT=188,cinder:INSERT=62,cinder:DELETE=19 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:59:04 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Volume volume-e4e92287-1672-4865-b4d0-c3aa6748a34d (e4e92287-1672-4865-b4d0-c3aa6748a34d): created successfully Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9a6f22-4968-4638-b122-9cfddf0e0909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:04 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (7a1967d7-b217-4e41-8e6c-38dc8412541b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:59:04 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-cf15b952-616b-4f5c-8ac0-5d493378974b tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=248,cinder:DELETE=21,cinder:SELECT=175,cinder:INSERT=67 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot c86d807c-3d9c-433a-b2b1-601e7fa32cb3 of volume e4e92287-1672-4865-b4d0-c3aa6748a34d {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[29df085d-4c79-43ed-924d-3f2efcf2d9e5]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:05 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d Nov 06 21:59:05 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:05 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d" returned: 0 in 0.345s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:05 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 1G Nov 06 21:59:05 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:05 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 1G" returned: 0 in 0.396s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:05 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e92287-1672-4865-b4d0-c3aa6748a34d -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:05 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e92287-1672-4865-b4d0-c3aa6748a34d -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 Nov 06 21:59:05 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:06 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4e92287-1672-4865-b4d0-c3aa6748a34d -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3" returned: 0 in 0.282s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:06 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 is being set with open permissions: ugo+rw Nov 06 21:59:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:06 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 Nov 06 21:59:06 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:06 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3" returned: 0 in 0.236s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:06 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.info Nov 06 21:59:06 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:06 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.info" returned: 0 in 0.245s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:06 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.info is being set with open permissions: ugo+rw Nov 06 21:59:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:06 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.info Nov 06 21:59:06 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:06 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.info" returned: 0 in 0.235s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:06 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:06 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b76afeb7-3bee-47af-891b-adc52c8137bb tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-c86d807c-3d9c-433a-b2b1-601e7fa32cb3-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-c86d807c-3d9c-433a-b2b1-601e7fa32cb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-e4e92287-1672-4865-b4d0-c3aa6748a34d" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-e4e92287-1672-4865-b4d0-c3aa6748a34d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-c86d807c-3d9c-433a-b2b1-601e7fa32cb3" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-c86d807c-3d9c-433a-b2b1-601e7fa32cb3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot c86d807c-3d9c-433a-b2b1-601e7fa32cb3 of volume e4e92287-1672-4865-b4d0-c3aa6748a34d {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7153db-5a6b-43cb-a244-5ef53727cf80]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:07 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 Nov 06 21:59:07 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:07 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3" returned: 0 in 0.355s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4e92287-1672-4865-b4d0-c3aa6748a34d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[227bea0c-2b1a-4c2c-b432-2590cae37e9b]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:07 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d Nov 06 21:59:07 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:07 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:07 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:08 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 Nov 06 21:59:08 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:08 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3" returned: 0 in 0.315s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:08 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3 Nov 06 21:59:08 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:08 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:08 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d.c86d807c-3d9c-433a-b2b1-601e7fa32cb3" returned: 0 in 0.237s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-c86d807c-3d9c-433a-b2b1-601e7fa32cb3" released by "_delete_snapshot" :: held 1.363s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-e4e92287-1672-4865-b4d0-c3aa6748a34d" released by "delete_snapshot" :: held 1.383s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:08 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Created reservations ['ef3ebab3-87e2-482b-9966-5d438c9764f7', 'dbd26049-a045-445c-88bc-65584711d59d', 'e69597dd-69db-4eda-87a0-9f911c96eb1a', '641bcc18-687b-49c4-829e-c2b17e5776d2'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:59:08 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:59:08 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-c758692c-4002-4206-af7b-e4d62ce70f65 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-c86d807c-3d9c-433a-b2b1-601e7fa32cb3-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-e4e92287-1672-4865-b4d0-c3aa6748a34d-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-e4e92287-1672-4865-b4d0-c3aa6748a34d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-e4e92287-1672-4865-b4d0-c3aa6748a34d" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:09 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-e4e92287-1672-4865-b4d0-c3aa6748a34d" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:09 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1448521c-3f0b-41fd-b61a-3adb977fb79a]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:09 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d Nov 06 21:59:09 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:09 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d" returned: 0 in 0.354s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:09 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:09 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d Nov 06 21:59:09 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:10 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-e4e92287-1672-4865-b4d0-c3aa6748a34d" returned: 0 in 0.241s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-e4e92287-1672-4865-b4d0-c3aa6748a34d" released by "delete_volume" :: held 0.657s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Created reservations ['496877f5-d994-4a5a-8dc6-5dc6725f3615', '6cb1c820-9445-4c14-9fdd-d4b021ab2c7c', '6cf12936-1d8d-46de-8c4d-ce814965ab2a', 'ad818294-36df-4b50-abcf-91e83590ee9d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:10 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:59:10 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:10 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.246s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:59:10 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-e7a6f8e3-9123-4f15-a456-ff7ca410330c tempest-ProjectMemberTests-1193509755 None] Lock "cinder-e4e92287-1672-4865-b4d0-c3aa6748a34d-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (5ce89940-0a21-44a9-839e-fcd72616db25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d30ae74-daed-4266-aa32-65ed49c5b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d30ae74-daed-4266-aa32-65ed49c5b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493001793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf864081-e9cc-48a4-8de0-64090e178a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:59:11Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58f3ebf-c4e5-4fde-b482-476c0303eb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58f3ebf-c4e5-4fde-b482-476c0303eb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30e42e8-5b93-4589-9c29-4662a3f89d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30e42e8-5b93-4589-9c29-4662a3f89d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf864081-e9cc-48a4-8de0-64090e178a5e', 'volume_name': 'volume-bf864081-e9cc-48a4-8de0-64090e178a5e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f45bed-3b60-4649-afaa-0dad668312fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f45bed-3b60-4649-afaa-0dad668312fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d98851f-ee46-4a7b-a866-64f768e8ab91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:10 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Volume bf864081-e9cc-48a4-8de0-64090e178a5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf864081-e9cc-48a4-8de0-64090e178a5e', 'volume_size': 1} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-493001793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf864081-e9cc-48a4-8de0-64090e178a5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdae5ae1a6d42f49fca60c34c6bdd21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:59:11Z,use_quota=True,user_id='1bd40e1dbd8a4b03af3c483d92f0d38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Creating volume bf864081-e9cc-48a4-8de0-64090e178a5e {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:59:10 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:59:10 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:10 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e 1073741824 Nov 06 21:59:10 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:11 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e 1073741824" returned: 0 in 0.393s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:11 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e Nov 06 21:59:11 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:11 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e" returned: 0 in 0.243s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d98851f-ee46-4a7b-a866-64f768e8ab91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf864081-e9cc-48a4-8de0-64090e178a5e', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77038923-80ad-415c-b067-2cdbe24c71d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:11 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Volume volume-bf864081-e9cc-48a4-8de0-64090e178a5e (bf864081-e9cc-48a4-8de0-64090e178a5e): created successfully Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77038923-80ad-415c-b067-2cdbe24c71d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:11 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Flow 'volume_create_manager' (5ce89940-0a21-44a9-839e-fcd72616db25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:59:11 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-482268e9-40bf-446b-a3e9-b19d99f3217e tempest-ProjectMemberTests-1193509755 None] Created volume successfully. Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Creating offline snapshot 0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b of volume bf864081-e9cc-48a4-8de0-64090e178a5e {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9fa704-ab13-4b62-ac19-5fc0f783ee26]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:12 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e Nov 06 21:59:12 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:12 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e" returned: 0 in 0.343s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:12 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b 1G Nov 06 21:59:12 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:12 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b 1G" returned: 0 in 0.380s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:12 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf864081-e9cc-48a4-8de0-64090e178a5e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:12 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf864081-e9cc-48a4-8de0-64090e178a5e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b Nov 06 21:59:12 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:13 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf864081-e9cc-48a4-8de0-64090e178a5e -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b" returned: 0 in 0.279s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:13 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b is being set with open permissions: ugo+rw Nov 06 21:59:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:13 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b Nov 06 21:59:13 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:13 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b" returned: 0 in 0.230s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:13 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.info Nov 06 21:59:13 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:13 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.info" returned: 0 in 0.255s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:13 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.info is being set with open permissions: ugo+rw Nov 06 21:59:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:13 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.info Nov 06 21:59:13 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:13 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.info" returned: 0 in 0.234s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:13 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.797s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:13 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-872ec92d-b188-44c0-93d1-e43ff438a637 tempest-ProjectMemberTests-1193509755 None] Create snapshot completed successfully Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-bf864081-e9cc-48a4-8de0-64090e178a5e" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-bf864081-e9cc-48a4-8de0-64090e178a5e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Deleting offline snapshot 0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b of volume bf864081-e9cc-48a4-8de0-64090e178a5e {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] snapshot_file for this snap is: volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d57653-0843-4f0b-9fc6-8e6c9a2e3270]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:14 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b Nov 06 21:59:14 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:14 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b" returned: 0 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf864081-e9cc-48a4-8de0-64090e178a5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e165cbe-10d4-4aa8-bbbf-d722ee56962f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:14 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:14 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e Nov 06 21:59:14 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:15 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:15 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b Nov 06 21:59:15 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:15 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b" returned: 0 in 0.335s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:15 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b Nov 06 21:59:15 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:15 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e.0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b" returned: 0 in 0.247s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b" released by "_delete_snapshot" :: held 1.380s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-bf864081-e9cc-48a4-8de0-64090e178a5e" released by "delete_snapshot" :: held 1.402s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Created reservations ['0a34e23b-1fae-427b-a2f5-38a850671e4d', 'b20591c5-f5f3-41e6-9336-dcf7626d59be', 'dc38f101-4cf2-458e-8560-5e0eb83ebc25', 'c33e0e61-a898-4f18-95e7-8fa6913edf4d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:59:15 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Delete snapshot completed successfully. Nov 06 21:59:15 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3bef9989-d910-449d-8d34-5791f2f18280 tempest-ProjectMemberTests-1193509755 None] Lock "cinder-0979b6e2-595c-4d05-83f6-5e9a7ccf3c3b-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-bf864081-e9cc-48a4-8de0-64090e178a5e-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Lock "cinder-bf864081-e9cc-48a4-8de0-64090e178a5e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Acquiring lock "cinder-quobyte-bf864081-e9cc-48a4-8de0-64090e178a5e" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:16 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-bf864081-e9cc-48a4-8de0-64090e178a5e" acquired by "delete_volume" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:16 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f94a179-a132-446b-a698-85fc4b3245de]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:16 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e Nov 06 21:59:16 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:16 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e" returned: 0 in 0.356s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:16 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:16 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e Nov 06 21:59:16 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:17 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-bf864081-e9cc-48a4-8de0-64090e178a5e" returned: 0 in 0.251s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Lock "cinder-quobyte-bf864081-e9cc-48a4-8de0-64090e178a5e" released by "delete_volume" :: held 0.663s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Created reservations ['fddb4feb-e61b-49c0-98f4-418841aecad8', '196eb90e-e1e9-4d4b-af16-964bd48b946a', 'c1365869-6212-48b7-a4d9-52a7641cbb4d', 'c75d7631-c87a-4bd5-add7-bd05fb5a792c'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:17 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:59:17 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:17 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.256s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:59:17 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Deleted volume successfully. Nov 06 21:59:17 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-76578c94-c9b1-4dcd-872b-a650bfc2219e tempest-ProjectMemberTests-1193509755 None] Lock "cinder-bf864081-e9cc-48a4-8de0-64090e178a5e-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:27 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:UPDATE=34,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:59:27 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Flow 'volume_create_manager' (ffce1e3d-bb93-4de0-991b-86f321163bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c495e60-4b19-4c6d-b027-7a354d283857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c495e60-4b19-4c6d-b027-7a354d283857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-888474285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a630e587-d662-4015-97b5-f051cfcb575a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1844772f2b440ba31816f9c9bf41f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:59:45Z,use_quota=True,user_id='2864c522a3b34b069c7eadc629bf15e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf295e2-d11d-412a-acd4-0338d448817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf295e2-d11d-412a-acd4-0338d448817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af10139-7112-492a-baaa-9d1c724ea6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af10139-7112-492a-baaa-9d1c724ea6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a630e587-d662-4015-97b5-f051cfcb575a', 'volume_name': 'volume-a630e587-d662-4015-97b5-f051cfcb575a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0eef4d0-a0e6-477d-bb1a-2271e24d9ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0eef4d0-a0e6-477d-bb1a-2271e24d9ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06676a3-e780-40c1-b81c-851bd5bda727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:45 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Volume a630e587-d662-4015-97b5-f051cfcb575a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a630e587-d662-4015-97b5-f051cfcb575a', 'volume_size': 1} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-888474285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a630e587-d662-4015-97b5-f051cfcb575a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1844772f2b440ba31816f9c9bf41f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:59:45Z,use_quota=True,user_id='2864c522a3b34b069c7eadc629bf15e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)}" {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Creating volume a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:59:45 devstack cinder-volume[87069]: INFO cinder.volume.drivers.remotefs [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] casted to osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a 1073741824 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:45 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a 1073741824 Nov 06 21:59:45 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:45 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a 1073741824" returned: 0 in 0.412s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:45 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a Nov 06 21:59:45 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:45 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a" returned: 0 in 0.242s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'} {{(pid=87069) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e06676a3-e780-40c1-b81c-851bd5bda727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a630e587-d662-4015-97b5-f051cfcb575a', 'volume_size': 1}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56b35a3-9d40-4d62-8c12-5d031c1ab450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:45 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Volume volume-a630e587-d662-4015-97b5-f051cfcb575a (a630e587-d662-4015-97b5-f051cfcb575a): created successfully Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56b35a3-9d40-4d62-8c12-5d031c1ab450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:45 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Flow 'volume_create_manager' (ffce1e3d-bb93-4de0-991b-86f321163bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:59:45 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-aa170e3b-d70d-413d-a049-89bc3da88c5e tempest-SnapshotDependencyTests-370861076 None] Created volume successfully. Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Creating offline snapshot 6d7069d4-ebc1-4130-b159-a8644d707b04 of volume a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd69e1ae-c296-42a0-bfee-e8bc05700713]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:46 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a Nov 06 21:59:46 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:46 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 1G {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:46 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 1G Nov 06 21:59:46 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:46 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 1G" returned: 0 in 0.380s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:46 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a630e587-d662-4015-97b5-f051cfcb575a -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:47 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a630e587-d662-4015-97b5-f051cfcb575a -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 Nov 06 21:59:47 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:47 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a630e587-d662-4015-97b5-f051cfcb575a -F qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04" returned: 0 in 0.287s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:47 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 is being set with open permissions: ugo+rw Nov 06 21:59:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:47 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 Nov 06 21:59:47 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:47 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04" returned: 0 in 0.238s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:47 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.info Nov 06 21:59:47 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:47 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.info" returned: 0 in 0.242s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:47 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.info is being set with open permissions: ugo+rw Nov 06 21:59:47 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.info {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:47 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.info Nov 06 21:59:47 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:48 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.info" returned: 0 in 0.242s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:48 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-ba04608c-c45e-45a8-8a12-151248b404a1 tempest-SnapshotDependencyTests-370861076 None] Create snapshot completed successfully Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87069) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Flow 'volume_create_manager' (deaddb78-5807-47ae-a6fd-ae0655612e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa18fcf-a479-485e-b58e-f02cd2210eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa18fcf-a479-485e-b58e-f02cd2210eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T20:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd1844772f2b440ba31816f9c9bf41f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T20:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d7069d4-ebc1-4130-b159-a8644d707b04,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T20:59:49Z,use_quota=True,user_id='2864c522a3b34b069c7eadc629bf15e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331),volume_type_id=ab81e2a6-c7d4-4fd4-98ff-ccfdd0c0e331)' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0e7169-9008-4a1f-9fa2-8ec0c5774523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0e7169-9008-4a1f-9fa2-8ec0c5774523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f06b29-3ac6-461d-b089-f5c743f134f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3f06b29-3ac6-461d-b089-f5c743f134f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b', 'volume_name': 'volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b', 'volume_size': 1, 'snapshot_id': '6d7069d4-ebc1-4130-b159-a8644d707b04'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9720ced-b919-4266-b306-b186fabebde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9720ced-b919-4266-b306-b186fabebde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f624e960-0a94-4ea8-8019-c352cbefdc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:48 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Volume a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b', 'volume_size': 1, 'snapshot_id': '6d7069d4-ebc1-4130-b159-a8644d707b04'} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-quobyte-6d7069d4-ebc1-4130-b159-a8644d707b04-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" by "_create_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-6d7069d4-ebc1-4130-b159-a8644d707b04-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Creating volume a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b from snapshot 6d7069d4-ebc1-4130-b159-a8644d707b04 {{(pid=87069) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Selected osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373 as target Quobyte volume. {{(pid=87069) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-quobyte-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" by "_copy_volume_from_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] snapshot: 6d7069d4-ebc1-4130-b159-a8644d707b04, volume: a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b, {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:48 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa5361-c53e-493e-a511-4657f13b42ec]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:49 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 Nov 06 21:59:49 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:49 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04" returned: 0 in 0.361s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a630e587-d662-4015-97b5-f051cfcb575a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f129f1-aa91-44e4-a8d9-a15b0b92331d]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:49 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a Nov 06 21:59:49 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:49 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a" returned: 0 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Creating direct copy from snapshot {{(pid=87069) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG cinder.utils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Path /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b not found in is_blk_device check {{(pid=87069) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 21:59:49 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:49 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b Nov 06 21:59:49 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:55 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" returned: 0 in 5.901s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG cinder.image.image_utils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Image conversion details: src /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b {{(pid=87069) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:556}} Nov 06 21:59:55 devstack cinder-volume[87069]: INFO cinder.image.image_utils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Converted 1024.00 MB image at 173.48 MB/s Nov 06 21:59:55 devstack cinder-volume[87069]: WARNING cinder.volume.drivers.remotefs [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b is being set with open permissions: ugo+rw Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:55 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b Nov 06 21:59:55 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:55 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" returned: 0 in 0.247s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" released by "_copy_volume_from_snapshot" :: held 6.942s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-6d7069d4-ebc1-4130-b159-a8644d707b04-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" released by "_create_volume_from_snapshot" :: held 7.001s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.016s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f624e960-0a94-4ea8-8019-c352cbefdc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b', 'volume_size': 1, 'snapshot_id': '6d7069d4-ebc1-4130-b159-a8644d707b04'}' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b78e99-7d49-4731-83e4-d429214f0aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 21:59:55 devstack cinder-volume[87069]: INFO cinder.volume.flows.manager.create_volume [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Volume volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b (a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b): created successfully Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b78e99-7d49-4731-83e4-d429214f0aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87069) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 21:59:55 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Flow 'volume_create_manager' (deaddb78-5807-47ae-a6fd-ae0655612e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87069) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 21:59:56 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-3d0a964b-039b-4dc9-bb57-9262807b4237 tempest-SnapshotDependencyTests-370861076 None] Created volume successfully. Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-6d7069d4-ebc1-4130-b159-a8644d707b04-delete_snapshot" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-6d7069d4-ebc1-4130-b159-a8644d707b04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-quobyte-a630e587-d662-4015-97b5-f051cfcb575a" by "delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-a630e587-d662-4015-97b5-f051cfcb575a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-quobyte-6d7069d4-ebc1-4130-b159-a8644d707b04" by "_delete_snapshot" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-6d7069d4-ebc1-4130-b159-a8644d707b04" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Deleting offline snapshot 6d7069d4-ebc1-4130-b159-a8644d707b04 of volume a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] snapshot_file for this snap is: volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 {{(pid=87069) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[386ae9d5-2588-4871-ac3e-da5edc85320f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:56 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 Nov 06 21:59:56 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:56 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04" returned: 0 in 0.353s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.remotefs [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a630e587-d662-4015-97b5-f051cfcb575a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87069) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[04534acc-58d4-482a-a246-123fc57d9c4f]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:56 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:57 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a Nov 06 21:59:57 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:57 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a" returned: 0 in 0.509s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:57 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 Nov 06 21:59:57 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:57 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04" returned: 0 in 0.321s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:57 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:57 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04 Nov 06 21:59:57 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:58 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a.6d7069d4-ebc1-4130-b159-a8644d707b04" returned: 0 in 0.243s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-6d7069d4-ebc1-4130-b159-a8644d707b04" released by "_delete_snapshot" :: held 1.531s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-a630e587-d662-4015-97b5-f051cfcb575a" released by "delete_snapshot" :: held 1.550s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Created reservations ['82b787a3-afd0-410f-9b0e-ad7bf05b4767', 'b5334baf-1dd1-4f1a-b0f8-f6e0e887cc41', 'e19434b5-16a4-46f1-bec5-0c285187cf05', '1b296e5e-1989-4c28-8eaf-8eefafe1aa4d'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:59:58 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Delete snapshot completed successfully. Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-1843a15e-d063-4399-8f35-ad29f9014a59 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-6d7069d4-ebc1-4130-b159-a8644d707b04-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-a630e587-d662-4015-97b5-f051cfcb575a-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-a630e587-d662-4015-97b5-f051cfcb575a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-quobyte-a630e587-d662-4015-97b5-f051cfcb575a" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-a630e587-d662-4015-97b5-f051cfcb575a" acquired by "delete_volume" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc8789c-7a5a-4227-8b98-46641675e9dc]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:58 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:59:58 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:58 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a Nov 06 21:59:58 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:58 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.248s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:58 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_service.periodic_task [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] Running periodic task VolumeManager._thread_info {{(pid=87069) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread count: 28 {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.volume.manager [None req-0c8ed2c9-3ab3-4944-9774-acbbd7d733ee None None] thread info: [<_MainThread(MainThread, started 136607822409856)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87069) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 21:59:59 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a" returned: 0 in 0.363s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:59 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a Nov 06 21:59:59 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:59 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a630e587-d662-4015-97b5-f051cfcb575a" returned: 0 in 0.241s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-a630e587-d662-4015-97b5-f051cfcb575a" released by "delete_volume" :: held 0.660s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Created reservations ['4e2dcb10-3b47-4bcf-b50a-98c058ad6eea', 'b18bfda0-dc95-4793-a486-dd8f79096e74', 'ecd90296-59c4-40f3-aeb6-e83e7238a6c6', '48b08bec-3edc-4b2d-b503-822448724e40'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:59 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 21:59:59 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 21:59:59 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.238s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 21:59:59 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Deleted volume successfully. Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-fba47a4e-8cec-4b50-bc98-56b67150dfa7 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-a630e587-d662-4015-97b5-f051cfcb575a-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b-delete_volume" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "cinder-quobyte-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" by "delete_volume" {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" acquired by "delete_volume" :: waited 0.013s {{(pid=87069) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7c21c5-eb03-4f9a-9d27-579e7387f7e2]: (4, 'qcow2') {{(pid=88361) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 21:59:59 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 21:59:59 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b Nov 06 21:59:59 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 22:00:00 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" returned: 0 in 0.355s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 22:00:00 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b Nov 06 22:00:00 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 22:00:00 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f/volume-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" returned: 0 in 0.239s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-quobyte-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b" released by "delete_volume" :: held 0.635s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG cinder.quota [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Created reservations ['e27f9238-4052-4808-88ce-9bd2fced87d7', 'b21ba699-4b85-420b-ad35-fe004dd938e6', '62754293-1c7a-41bd-abf4-1da45d876501', '13bdb3f4-783e-4912-a518-3722c13ab604'] {{(pid=87069) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373': None} {{(pid=87069) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG cinder.volume.drivers.quobyte [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7c44a25d-ef27-475c-b499-c4389228f373'] {{(pid=87069) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.lockutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87069) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 22:00:00 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f Nov 06 22:00:00 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 22:00:00 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG oslo_concurrency.processutils [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f068137c912027e6f21f09fab7b13f2f" returned: 0 in 0.233s {{(pid=87069) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG cinder.manager [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Notifying Schedulers of capabilities ... {{(pid=87069) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 22:00:00 devstack cinder-volume[87069]: INFO cinder.volume.manager [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Deleted volume successfully. Nov 06 22:00:00 devstack cinder-volume[87069]: DEBUG cinder.coordination [None req-b2bc6563-9427-4006-9906-e24d48fe6b87 tempest-SnapshotDependencyTests-370861076 None] Lock "cinder-a0092c02-dc01-4f6e-9cde-fc3afc9f0f9b-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87069) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 22:00:10 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=25,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 22:00:10 devstack cinder-volume[87069]: DEBUG dbcounter [-] [87069] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87069) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}